Enum OutputStability 

pub enum OutputStability {
    NotMeasured,
    Stable,
    Unstable,
    Incomplete,
}

A case’s output-level stability across repeated samples — independent of pass/fail. flaky only tells you the verdict flipped; a case can fail every sample with a different wrong answer each time and flaky never notices, because pass never changes. This classification is derived on read from samples/answer_dist rather than stored, so it can never drift out of sync with the data it summarizes and needs no new field or legacy-report migration.

Variants

NotMeasured

--record-answers was off, or samples <= 1 (nothing to compare across samples).

Stable

Every sample produced an answer, and every answer had the same textual signature.

Unstable

Two or more distinct textual answer signatures were seen across samples. This is an upper bound on real (semantic) instability, not an exact count: render_answer is a textual signature, not the comparator’s semantic one, so set/unordered match modes or a bare number-scale difference (42 vs 42.0) can over-split a comparator-equal result into separate buckets here. flaky_cases/flaky is the complementary exact lower bound — it only ever fires on an actual verdict flip, never on textual noise — so the two numbers are reported side by side, both labelled, rather than folded into one bare count that would read as precise.

Incomplete

Answer buckets summed to fewer than samples — at least one sample produced no answer at all (an outright invocation failure, not a parseable-but-wrong result). Never classified as Stable: a missing sample is not agreement, it’s missing data.

Trait Implementations

impl Clone for OutputStability

fn clone(&self) -> Self

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Copy for OutputStability

impl Debug for OutputStability

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl Eq for OutputStability

impl PartialEq for OutputStability

fn eq(&self, other: &Self) -> bool

Equality operator ==.

fn ne(&self, other: &Rhs) -> bool

Inequality operator !=.

impl StructuralPartialEq for OutputStability