Module comparison 

Aggregate baseline-versus-treatment comparison.

Structs

AggregateMetrics

DeltaMetrics

Recommendation

SavingsMetrics

ShadowReport

Constants

BASELINE_NOTE

#1905: the baseline is simulated from the same task and outcome signals as the treatment, so the acceptance comparison cannot show a quality change.

LEGACY_NOTE

LEGACY_SEMANTICS

Reports written before 3.11.0 carry no semantics field. Their baseline was priced with a fixed reference model, so cost differences may be model price differences and their recommendations may name a model switch. They are kept as records, never shown as current.

SAME_HOST_MODEL_SEMANTICS

Reports whose baseline uses each task’s own host model (3.11.0 and later).

Functions

compare

format_report