Struct Variance 

pub struct Variance {
    pub samples: usize,
    pub distinct_behaviours: usize,
    pub pass_rate: f64,
    pub pass_variance: f64,
    pub behaviours: Vec<BehaviourCount>,
}

How much the agent under test varied across the samples of one item.

This is the number samples_per_item exists to produce. It is about the model; no judge vote contributes to it.

Fields

samples: usize

How many samples ran.

distinct_behaviours: usize

How many distinct behaviours were observed. One means the model was perfectly repeatable — whether or not it was right.

pass_rate: f64

Fraction of samples that satisfied every deterministic expectation.

pass_variance: f64

Variance of the pass indicator, p * (1 - p). Zero when every sample agreed; at its maximum when half of them did.

behaviours: Vec<BehaviourCount>

How often each distinct behaviour occurred, most frequent first.

Implementations

impl Variance

pub const fn is_flaky(&self) -> bool

Returns true when the samples disagreed with each other.

Trait Implementations

impl Clone for Variance

fn clone(&self) -> Self

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Debug for Variance

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl<'de> Deserialize<'de> for Variance

fn deserialize<__D>(__deserializer: __D) -> Result<Self, __D::Error>

where __D: Deserializer<'de>,

Deserialize this value from the given Serde deserializer.

impl PartialEq for Variance

fn eq(&self, other: &Self) -> bool

Equality operator ==.

fn ne(&self, other: &Rhs) -> bool

Inequality operator !=.

impl Serialize for Variance

fn serialize<__S>(&self, __serializer: __S) -> Result<__S::Ok, __S::Error>

where __S: Serializer,

Serialize this value into the given Serde serializer.

impl StructuralPartialEq for Variance