Struct RoutingStatistics 

pub struct RoutingStatistics { /* private fields */ }

Routing statistics for monitoring with lock-free atomic counters

All counter fields use AtomicU64 for lock-free concurrent updates. Only the confidence score circular buffer requires a Mutex, which is held very briefly during score insertion or averaging.

Implementations

impl RoutingStatistics

pub fn total_requests(&self) -> u64

Get total number of requests processed

pub fn slm_routes(&self) -> u64

Get number of requests routed to SLM

pub fn llm_routes(&self) -> u64

Get number of requests routed to LLM

pub fn denied_routes(&self) -> u64

Get number of denied requests

pub fn fallback_routes(&self) -> u64

Get number of fallback routes (SLM -> LLM)

pub fn average_response_time(&self) -> Duration

Compute average response time from cumulative nanos and total requests

pub fn success_rate(&self) -> f64

Compute success rate from successful and total requests

pub fn record_request( &self, decision: &RouteDecision, response_time: Duration, success: bool, )

Record a completed request, updating all relevant counters atomically

pub fn record_fallback(&self)

Record a fallback from SLM to LLM

pub fn add_confidence_score(&self, score: f64)

Add a confidence score (takes Mutex briefly)

pub fn average_confidence(&self) -> Option<f64>

Get average confidence score (takes Mutex briefly)

Trait Implementations

impl Clone for RoutingStatistics

fn clone(&self) -> Self

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Debug for RoutingStatistics

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl Default for RoutingStatistics

fn default() -> Self

Returns the “default value” for a type.