Struct CaseRun 

pub struct CaseRun {
    pub case: String,
    pub skill: String,
    pub platform: String,
    pub model: String,
    pub passed: bool,
    pub turns: usize,
    pub evals: Vec<EvalOutcome>,
    pub transcript: Transcript,
    pub usage: Option<Usage>,
    pub mock_calls: Option<Vec<MockCall>>,
    pub history_command: Option<String>,
}

The result of running one test case on one (platform, model) pair.

Fields

case: String

The test case name.

skill: String

Absolute-ish path to the skill that was exercised.

platform: String

The harness platform this run used.

model: String

The model this run used.

passed: bool

True iff every eval in this run passed.

turns: usize

Number of assistant turns produced.

evals: Vec<EvalOutcome>

Per-eval outcomes, in declaration order.

transcript: Transcript

The full conversation, for debugging and deterministic mix-in checks.

usage: Option<Usage>

Aggregated token/cost usage across every provider call in this run (skill turns + simulated-user turns + judge calls). Omitted when no usage was reported (e.g. the fake provider or a harness that doesn’t surface usage).

mock_calls: Option<Vec<MockCall>>

Every tool call the mock/spy channel observed, in order, with the original (pre-rewrite) input and the verdict applied. null when the channel was off for this run (no mocks, no spy); an empty array means the channel was on and the skill made no tool calls — SDKs use that distinction so a spy on a channel-less run errs instead of reading as “zero calls”.

history_command: Option<String>

A ready-to-run command that replays this run’s recorded transcript — e.g. oneharness history show <name> --history-dir <dir> — so a past run can be reviewed after the fact. Present only when the run was recorded (the oneharness provider with history enabled); null for providers/configs that record no history.

Trait Implementations

impl Clone for CaseRun

fn clone(&self) -> CaseRun

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Debug for CaseRun

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl<'de> Deserialize<'de> for CaseRun

fn deserialize<__D>(__deserializer: __D) -> Result<Self, __D::Error>

where __D: Deserializer<'de>,

Deserialize this value from the given Serde deserializer.

impl JsonSchema for CaseRun

fn schema_name() -> Cow<'static, str>

The name of the generated JSON Schema.

fn schema_id() -> Cow<'static, str>

Returns a string that uniquely identifies the schema produced by this type.

fn json_schema(generator: &mut SchemaGenerator) -> Schema

Generates a JSON Schema for this type.

fn inline_schema() -> bool

Whether JSON Schemas generated for this type should be included directly in parent schemas, rather than being re-used where possible using the $ref keyword.

impl PartialEq for CaseRun

fn eq(&self, other: &CaseRun) -> bool

Tests for self and other values to be equal, and is used by ==.

fn ne(&self, other: &Rhs) -> bool

Tests for !=. The default implementation is almost always sufficient, and should not be overridden without very good reason.

impl Serialize for CaseRun

fn serialize<__S>(&self, __serializer: __S) -> Result<__S::Ok, __S::Error>

where __S: Serializer,

Serialize this value into the given Serde serializer.

impl StructuralPartialEq for CaseRun