Struct ToolExecutor 

pub struct ToolExecutor { /* private fields */ }

APR Tool test executor for comprehensive tool coverage

Implementations

impl ToolExecutor

pub fn new(model_path: String, no_gpu: bool, timeout_ms: u64) -> Self

Create a new tool executor

pub fn with_runner( model_path: String, no_gpu: bool, timeout_ms: u64, runner: Arc<dyn CommandRunner>, ) -> Self

Create a new tool executor with custom command runner

pub fn execute_inspect(&self) -> ToolTestResult

Execute apr rosetta inspect (works with any format)

pub fn execute_inspect_verified(&self) -> ToolTestResult

Execute apr rosetta inspect with metadata verification (T-GH192-01)

Parses --json output and validates that critical model metadata fields are present and non-zero. This catches models with missing or corrupted config (e.g., num_heads=0, hidden_size=0).

Gate: F-INSPECT-META-001

pub fn execute_validate(&self) -> ToolTestResult

Execute apr validate

pub fn execute_bench(&self) -> ToolTestResult

Execute apr bench

pub fn execute_check(&self) -> ToolTestResult

Execute apr check

pub fn execute_trace(&self, level: &str) -> ToolTestResult

Execute apr trace with specified level

pub fn execute_profile(&self) -> ToolTestResult

Execute apr profile (standalone command)

pub fn execute_profile_ci(&self) -> ToolTestResult

Execute apr profile in CI mode with assertions (F-PROFILE-006)

Tests the CI mode features:

• --ci flag for CI mode with assertion checks
• --assert-throughput minimum tok/s assertion
• --warmup and --measure pass counts

Returns pass if CI mode runs and reports metrics correctly.

pub fn execute_profile_ci_assertion_failure(&self) -> ToolTestResult

Execute apr profile CI with assertion failure test (F-PROFILE-007)

Tests that CI mode correctly fails when assertions are not met. Uses an impossibly high throughput assertion to guarantee failure.

pub fn execute_profile_ci_p99(&self) -> ToolTestResult

Execute apr profile with p99 latency assertion (F-PROFILE-008)

pub fn execute_profile_flamegraph(&self, output_path: &Path) -> ToolTestResult

Execute apr profile with flamegraph output (F-PROFILE-002)

Tests that profile can generate valid SVG flamegraph output. This feature may not be available in all apr versions.

pub fn execute_profile_focus(&self, focus: &str) -> ToolTestResult

Execute apr profile with focus filtering (F-PROFILE-003)

Tests that profile –focus option works to limit scope. This feature may not be available in all apr versions.

pub fn execute_backend_equivalence(&self) -> ToolTestResult

Execute backend equivalence test (F-CONV-BE-001)

Compares CPU vs GPU output to verify they produce equivalent results. Skips if GPU is not available.

pub fn execute_serve_lifecycle(&self) -> ToolTestResult

Execute apr serve lifecycle test (F-INTEG-003)

Tests the full serve lifecycle:

1. Start server
2. Wait for health endpoint
3. Make inference request
4. Shutdown cleanly

pub fn execute_all(&self) -> Vec<ToolTestResult>

Execute all tool tests

pub fn execute_all_with_serve(&self, include_serve: bool) -> Vec<ToolTestResult>

Execute all tool tests, optionally including serve lifecycle

Trait Implementations

impl Debug for ToolExecutor

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.