Expand description
Shadow scheduler: samples a fraction of traffic and runs the frontier comparison + judge in the background.
The proxy calls ShadowScheduler::maybe_enqueue(...) synchronously
after returning the cheap-model response to the user. If the sample
roll succeeds, the scheduler fires a tokio::spawn that runs the
frontier call + judge + aggregator update. User-facing latency is
unaffected.