Enum Eval 

pub enum Eval {
    Boolean {
        criterion: String,
        expected: bool,
        name: Option<String>,
    },
    Numeric {
        criterion: String,
        min: f64,
        max: f64,
        threshold: f64,
        comparator: Comparator,
        name: Option<String>,
    },
}

An eval specification, as written in a test case’s YAML.

Variants

Boolean

Assert a plain-English criterion holds (or, with expected: false, that it does not).

Fields

criterion: String

The criterion the judge evaluates against the transcript.

expected: bool

What the judge’s verdict must equal to pass. Defaults to true.

name: Option<String>

Optional human label for reports.

Numeric

Score a plain-English criterion on a numeric scale and compare it to a threshold.

Fields

criterion: String

The criterion the judge scores.

min: f64

Inclusive lower bound of the scale.

max: f64

Inclusive upper bound of the scale.

threshold: f64

The passing threshold.

comparator: Comparator

How the score is compared to threshold. Defaults to >=.

name: Option<String>

Optional human label for reports.

Implementations

impl Eval

pub fn criterion(&self) -> &str

The criterion text the judge sees.

pub fn label(&self) -> &str

A short label for reports: the explicit name if given, else the criterion.

pub fn validate(&self) -> Result<()>

Validate the eval’s own parameters (independent of any transcript).

Errors

Error::Invalid when a criterion is empty or a numeric scale is degenerate (min >= max) or the threshold falls outside [min, max].

pub fn outcome(&self, raw: &JudgeValue, reason: String) -> Result<EvalOutcome>

Apply this eval’s pass rule to a raw judge value, producing an outcome.

raw is the value the judge returned: JudgeValue::Bool for boolean evals, JudgeValue::Number for numeric. A mismatch is a provider error.

Errors

Error::Provider if the judge returned the wrong value kind for this eval.

Trait Implementations

impl Clone for Eval

fn clone(&self) -> Eval

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Debug for Eval

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl<'de> Deserialize<'de> for Eval

fn deserialize<__D>(__deserializer: __D) -> Result<Self, __D::Error>

where __D: Deserializer<'de>,

Deserialize this value from the given Serde deserializer.

impl PartialEq for Eval

fn eq(&self, other: &Eval) -> bool

Tests for self and other values to be equal, and is used by ==.

fn ne(&self, other: &Rhs) -> bool

Tests for !=. The default implementation is almost always sufficient, and should not be overridden without very good reason.

impl Serialize for Eval

fn serialize<__S>(&self, __serializer: __S) -> Result<__S::Ok, __S::Error>

where __S: Serializer,

Serialize this value into the given Serde serializer.

impl StructuralPartialEq for Eval