pub struct NoiseFloor {
pub suite: String,
pub items_compared: usize,
pub unpaired_items: usize,
pub pass_rate: f64,
pub judge_score: f64,
pub suite_pass_rate: f64,
pub moved: Vec<ItemNoise>,
}Expand description
How much the unchanged system moved when it was measured twice.
Fields§
§suite: StringThe suite the control run measured.
items_compared: usizeHow many items appeared in both passes.
unpaired_items: usizeHow many appeared in only one, and therefore said nothing.
pass_rate: f64The largest absolute movement in any one item’s deterministic pass rate. This is the number a pass-rate difference is judged against.
judge_score: f64The largest absolute movement in any one item’s mean judge score.
suite_pass_rate: f64The movement of the suite-wide pass rate, for a reader who wants the headline rather than the worst item.
moved: Vec<ItemNoise>Every item that moved at all, worst first is not assumed — they are in suite order, so the list reads like the corpus.
Implementations§
Source§impl NoiseFloor
impl NoiseFloor
Sourcepub fn deterministic(suite: impl Into<String>) -> Self
pub fn deterministic(suite: impl Into<String>) -> Self
A floor of exactly zero, for a system asserted to be deterministic.
Use it when a corpus is scripted end to end and any movement at all is news. It is not a default: assuming a floor of zero without measuring one is the assumption this module exists to replace.
Sourcepub fn covers_pass_rate(&self, delta: f64) -> bool
pub fn covers_pass_rate(&self, delta: f64) -> bool
Returns true when a pass-rate difference is no larger than the
movement the unchanged system produced.
Sourcepub fn covers_judge_score(&self, delta: f64) -> bool
pub fn covers_judge_score(&self, delta: f64) -> bool
Returns true when a judge-score difference is no larger than the
movement the unchanged system produced.