Expand description
Recalibrate the conformal serving threshold from real deferred feedback (SPEC §10.1, run against live traffic instead of a static benchmark suite) — the “learns your quality bar” loop.
Enumerates stored traces, pairs each trace that has a deferred outcome with the score of the
attempt actually served, and hands the pairs to firstpass_core::conformal. This produces
a recommended threshold and its feasibility; it does not (yet) feed back into the request hot
path — that wiring is a deliberate follow-on once an operator has reviewed a report.
Structs§
- Calibration
Report - The result of calibrating a conformal threshold against real deferred feedback.
Functions§
- calibrate_
from_ store - Calibrate a conformal threshold from every trace in the store that has a deferred outcome recorded.
- calibrate_
pairs - Calibrate a conformal threshold from
(score, correct)pairs — a thin wrapper overfirstpass_core::conformalthat also reports the empirical served-failure at the chosen threshold.