Skip to main content

TestCaseResult

Type Alias TestCaseResult 

Source
pub type TestCaseResult = EvaluationResult;
Available on crate feature eval only.
Expand description

Result for a single test case (alias for backward compatibility)

Aliased Type§

pub struct TestCaseResult {
    pub eval_id: String,
    pub passed: bool,
    pub scores: HashMap<String, f64>,
    pub failures: Vec<Failure>,
    pub duration: Duration,
    pub turn_results: Vec<TurnResult>,
    pub cost_metrics: Option<CostMetrics>,
    pub trace_analysis: Option<TraceAnalysis>,
    pub verdicts: Vec<StructuredVerdict>,
}

Fields§

§eval_id: String

Test case identifier

§passed: bool

Whether the test passed all criteria

§scores: HashMap<String, f64>

Scores for each criterion

§failures: Vec<Failure>

Failures (criteria that didn’t meet threshold)

§duration: Duration

Execution duration

§turn_results: Vec<TurnResult>

Detailed turn results

§cost_metrics: Option<CostMetrics>

Cost and latency metrics (populated when CostTracker is active)

§trace_analysis: Option<TraceAnalysis>

Trace analysis results (populated when TraceAnalyzer is active)

§verdicts: Vec<StructuredVerdict>

Structured verdicts from the judge