Struct MetricsProvider 

pub struct MetricsProvider { /* private fields */ }

Decorator wrapping any Box<dyn LlmProvider> to collect latency, token, and cost metrics.

Usage

let metered = MetricsProvider::new(provider);
// ... use metered as LlmProvider ...
let report = metered.report().unwrap(); // Safe: test assertion
println!("calls={} avg_latency={}ms", report.call_count, report.avg_latency_ms);

Implementations

impl MetricsProvider

pub fn new(inner: Box<dyn LlmProvider>) -> Self

Wrap a provider with metrics collection

pub fn report(&self) -> Result<MetricsReport, RunnerError>

Return a snapshot of the current metrics

Errors

Returns RunnerError if the internal mutex is poisoned.

pub fn reset(&self) -> Result<(), RunnerError>

Reset all counters to zero

Errors

Returns RunnerError if the internal mutex is poisoned.

Trait Implementations

impl LlmProvider for MetricsProvider

fn complete_stream<'life0, 'life1, 'async_trait>( &'life0 self, request: &'life1 ChatRequest, ) -> Pin<Box<dyn Future<Output = Result<ChatStream, RunnerError>> + Send + 'async_trait>>

where Self: 'async_trait, 'life0: 'async_trait, 'life1: 'async_trait,

Delegate streaming directly; only measures stream setup time (documented limitation)

fn name(&self) -> &'static str

Unique provider identifier (e.g., claude_code, copilot)

fn display_name(&self) -> &str

Human-readable display name for the provider

fn capabilities(&self) -> LlmCapabilities

Provider capabilities (streaming, function calling, etc.)

fn default_model(&self) -> &str

Default model to use if not specified in request

fn available_models(&self) -> &[String]

Available models for this provider

fn complete<'life0, 'life1, 'async_trait>( &'life0 self, request: &'life1 ChatRequest, ) -> Pin<Box<dyn Future<Output = Result<ChatResponse, RunnerError>> + Send + 'async_trait>>

where Self: 'async_trait, 'life0: 'async_trait, 'life1: 'async_trait,

Perform a chat completion (non-streaming)

fn health_check<'life0, 'async_trait>( &'life0 self, ) -> Pin<Box<dyn Future<Output = Result<bool, RunnerError>> + Send + 'async_trait>>

where Self: 'async_trait, 'life0: 'async_trait,

Check if the provider is healthy and ready to serve requests