Enum Metric 

pub enum Metric {
    EndedOnFailedCall,
    ToolErrorRate,
    CutShort,
    Compactions,
    Turns,
    MalformedArgs,
}

What a candidate claims it will do.

Variants

EndedOnFailedCall

Runs that finished with their last tool call failed.

ToolErrorRate

Share of attempted tool calls the environment refused.

CutShort

Runs the harness cut short rather than the model finishing.

Compactions

Summaries taken. Fewer is better only when the work is unchanged, which is what the work guardrail is for.

Turns

Turns spent.

MalformedArgs

Arguments the model produced that did not parse.

Implementations

impl Metric

pub fn of(&self, s: &RunStats) -> f64

The metric’s value for one run. Lower is better for every metric here, which is a deliberate constraint rather than a coincidence: a mixed polarity is the kind of thing that inverts a comparison silently, so anything worth predicting gets phrased as a cost.

Trait Implementations

impl Clone for Metric

fn clone(&self) -> Metric

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Copy for Metric

impl Debug for Metric

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl<'de> Deserialize<'de> for Metric

fn deserialize<__D>(__deserializer: __D) -> Result<Self, __D::Error>

where __D: Deserializer<'de>,

Deserialize this value from the given Serde deserializer.

impl Eq for Metric

impl PartialEq for Metric

fn eq(&self, other: &Metric) -> bool

Equality operator ==.

fn ne(&self, other: &Rhs) -> bool

Inequality operator !=.

impl Serialize for Metric

fn serialize<__S>(&self, __serializer: __S) -> Result<__S::Ok, __S::Error>

where __S: Serializer,

Serialize this value into the given Serde serializer.

impl StructuralPartialEq for Metric