Struct ABTestRunner 

pub struct ABTestRunner { /* private fields */ }

Routes inference requests between two variants and records metrics.

Implementations

impl ABTestRunner

pub fn new( config: ABTestConfig, control: ModelVariant, treatment: ModelVariant, ) -> Result<Self>

Create a new A/B test runner.

pub fn route(&mut self, key: &str) -> Result<(Vec<f64>, String)>

Route a single request to a variant, returning (embedding, variant_name).

The variant is chosen deterministically based on key and the LCG state, ensuring the configured traffic_split is respected on average.

pub fn record_metric(&mut self, variant_name: &str, metric: f64) -> Result<()>

Record a metric observation for a variant.

Call this after routing to register the quality signal for the request.

pub fn record_observation(&mut self, obs: Observation) -> Result<()>

Record a full observation (metric + latency + key).

pub fn analyze(&self) -> Result<ABTestReport>

Analyze the collected observations and return a report.

pub fn total_requests(&self) -> usize

Number of requests routed so far.

pub fn observations(&self) -> &[Observation]

All recorded observations.

pub fn variant_stats(&self) -> HashMap<String, VariantStats>

Get per-variant summary statistics without a full report.

Trait Implementations

impl Debug for ABTestRunner

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.