Struct ComparisonPolicy 

pub struct ComparisonPolicy {
    pub tolerance: DriftTolerance,
    pub max_excluded_share: f64,
    pub noise_floor: Option<NoiseFloor>,
}

Everything compare needs beyond the two reports.

use turnframe_eval::baseline::ComparisonPolicy;

// A tenth of the corpus may go unpaired before a headline is refused.
assert!((ComparisonPolicy::default().max_excluded_share - 0.1).abs() < 1e-9);

Fields

tolerance: DriftTolerance

How much movement is noise rather than news.

max_excluded_share: f64

The fraction of the paired corpus that may be excluded before the comparison refuses to produce a headline number.

A tenth by default, and deliberately low. The number exists because a report over a third of a corpus reads exactly like a report over all of it, and nothing in the shape of the output would ever tell a reader otherwise. Raise it only when you have looked at the exclusions and decided they are acceptable.

noise_floor: Option<NoiseFloor>

What the same code produced against itself, when a control run measured it.

None leaves every change NoiseVerdict::Unmeasured: without a control run there is no honest way to say whether a difference is signal.

Implementations

impl ComparisonPolicy

pub fn new(tolerance: DriftTolerance) -> Self

A policy with this tolerance and the default exclusion ceiling.

pub const fn with_max_excluded_share(self, share: f64) -> Self

Sets how much of the paired corpus may be excluded before the headline is withheld.

pub fn with_noise_floor(self, floor: NoiseFloor) -> Self

Attaches the floor a control run measured.

Trait Implementations

impl Clone for ComparisonPolicy

fn clone(&self) -> Self

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Debug for ComparisonPolicy

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl Default for ComparisonPolicy

fn default() -> Self

Returns the “default value” for a type.

impl<'de> Deserialize<'de> for ComparisonPolicy

where ComparisonPolicy: Default,

fn deserialize<__D>(__deserializer: __D) -> Result<Self, __D::Error>

where __D: Deserializer<'de>,

Deserialize this value from the given Serde deserializer.

impl PartialEq for ComparisonPolicy

fn eq(&self, other: &Self) -> bool

Equality operator ==.

fn ne(&self, other: &Rhs) -> bool

Inequality operator !=.

impl Serialize for ComparisonPolicy

fn serialize<__S>(&self, __serializer: __S) -> Result<__S::Ok, __S::Error>

where __S: Serializer,

Serialize this value into the given Serde serializer.

impl StructuralPartialEq for ComparisonPolicy