Skip to main content

compare

Function compare 

Source
pub fn compare(
    baseline: &EvaluationReport,
    candidate: &EvaluationReport,
) -> Result<ComparisonReport, EvaluationError>
Expand description

Compare two saved reports without turning a regression into a CI gate.

Dataset or question-schema changes make reports incomparable. Model and provider changes are recorded while comparable metric regressions remain visible to a human caller.

§Errors

Returns EvaluationError::Invalid for malformed reports.