Skip to main content

Module calibrate

Module calibrate 

Source
Expand description

Recalibrate the conformal serving threshold from real deferred feedback (SPEC §10.1, run against live traffic instead of a static benchmark suite) — the “learns your quality bar” loop.

Enumerates stored traces, pairs each trace that has a deferred outcome with the score of the attempt actually served, and hands the pairs to firstpass_core::conformal. This produces a recommended threshold and its feasibility; it does not (yet) feed back into the request hot path — that wiring is a deliberate follow-on once an operator has reviewed a report.

Structs§

CalibrationReport
The result of calibrating a conformal threshold against real deferred feedback.

Functions§

calibrate_from_store
Calibrate a conformal threshold from every trace in the store that has a deferred outcome recorded.
calibrate_pairs
Calibrate a conformal threshold from (score, correct) pairs — a thin wrapper over firstpass_core::conformal that also reports the empirical served-failure at the chosen threshold.