pub struct PredictorEval {
pub n: usize,
pub auc: Option<f64>,
pub brier: f64,
}Expand description
Aggregate gate verdicts + routing behavior over traces (enforce only).
Prequential evaluation of the per-query gate-pass predictor (ADR 0008 Phase 2) — the honest
“is it any good yet” check before the predictor is ever allowed to act. Replays the receipts
in order through a fresh predictor: for each attempt with a clear Pass/Fail verdict, predict
before update (so every prediction is on data the model has not trained on), then update.
Reports AUC (predicted -> passed) and Brier score over those pairs.
Fields§
§n: usizeLabeled attempts evaluated.
auc: Option<f64>AUC of predicted P(pass) ranking actual passes above fails. 0.5 = no signal; 1.0 = perfect.
None when one class is absent (all pass or all fail — AUC undefined).
brier: f64Mean squared error of the probabilistic prediction, in [0, 1]. Lower is better; 0.25 is
the always-0.5 baseline.
Trait Implementations§
Source§impl Debug for PredictorEval
impl Debug for PredictorEval
Auto Trait Implementations§
impl Freeze for PredictorEval
impl RefUnwindSafe for PredictorEval
impl Send for PredictorEval
impl Sync for PredictorEval
impl Unpin for PredictorEval
impl UnsafeUnpin for PredictorEval
impl UnwindSafe for PredictorEval
Blanket Implementations§
Source§impl<T> BorrowMut<T> for Twhere
T: ?Sized,
impl<T> BorrowMut<T> for Twhere
T: ?Sized,
Source§fn borrow_mut(&mut self) -> &mut T
fn borrow_mut(&mut self) -> &mut T
impl<ST, DT> CastableFrom<ST, Initialized, Initialized> for DT
impl<ST, DT> CastableFrom<ST, Uninit, Uninit> for DT
Source§impl<T> Instrument for T
impl<T> Instrument for T
Source§fn instrument(self, span: Span) -> Instrumented<Self>
fn instrument(self, span: Span) -> Instrumented<Self>
Source§fn in_current_span(self) -> Instrumented<Self>
fn in_current_span(self) -> Instrumented<Self>
Source§impl<T> IntoEither for T
impl<T> IntoEither for T
Source§fn into_either(self, into_left: bool) -> Either<Self, Self>
fn into_either(self, into_left: bool) -> Either<Self, Self>
self into a Left variant of Either<Self, Self>
if into_left is true.
Converts self into a Right variant of Either<Self, Self>
otherwise. Read moreSource§fn into_either_with<F>(self, into_left: F) -> Either<Self, Self>
fn into_either_with<F>(self, into_left: F) -> Either<Self, Self>
self into a Left variant of Either<Self, Self>
if into_left(&self) returns true.
Converts self into a Right variant of Either<Self, Self>
otherwise. Read more