Struct AbReport 

pub struct AbReport {
    pub treatment: ArmSpec,
    pub control: ArmSpec,
    pub cells: Vec<AbCell>,
    pub stats: PairedStats,
}

The full report: every paired cell plus the aggregate stats. Serializes to the timestamped JSON the car coder-ab CLI writes to bench/results.

Fields

treatment: ArmSpec

The arm under test.

control: ArmSpec

The reference arm.

cells: Vec<AbCell>

stats: PairedStats

Implementations

impl AbReport

pub fn from_cells( cells: Vec<AbCell>, treatment: ArmSpec, control: ArmSpec, ) -> Self

Fold cells into a report against the two arms that produced them.

pub fn same_backbone(&self) -> Option<bool>

Whether both arms ran the same pinned backbone — the fairness rule that makes pass_rate_delta a harness measurement rather than a model measurement (backbone choice is ~3× the harness spread).

None when either arm is unpinned: the honest answer is then unknown, not “yes”. This used to be unknowable — the report recorded a single backbone string the operator asserted, while the pin reached only the native loop. false is a legitimate, deliberate configuration (the cross-tier diagonal); what must never happen is believing it is true without having checked. Some(false) means the two arms carry different pin strings — which is not quite the same as “different models”, because the id namespaces differ per engine (parslee/reasoning and gpt-5.5 name one backbone by two routes). We cannot resolve that equivalence here, so the honest reading is “different pins, check what you intended”, not “different tiers”. Identical pins are unambiguous.

pub fn summary_line(&self) -> String

A one-line human summary for the CLI table footer.

Trait Implementations

impl Clone for AbReport

fn clone(&self) -> Self

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Debug for AbReport

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl<'de> Deserialize<'de> for AbReport

fn deserialize<__D>(__deserializer: __D) -> Result<Self, __D::Error>

where __D: Deserializer<'de>,

Deserialize this value from the given Serde deserializer.

impl PartialEq for AbReport

fn eq(&self, other: &Self) -> bool

Equality operator ==.

fn ne(&self, other: &Rhs) -> bool

Inequality operator !=.

impl Serialize for AbReport

fn serialize<__S>(&self, __serializer: __S) -> Result<__S::Ok, __S::Error>

where __S: Serializer,

Serialize this value into the given Serde serializer.

impl StructuralPartialEq for AbReport