Struct RequestMetrics 

pub struct RequestMetrics {
    pub route: String,
    pub endpoint: String,
    pub latency_ms: u64,
    pub is_error: bool,
    pub input_tokens: Option<u32>,
    pub output_tokens: Option<u32>,
}

Data captured from a single completed request, used to update the store.

Fields

route: String

The route name (incoming model name).

endpoint: String

The endpoint identifier, typically "provider:model_id".

latency_ms: u64

Request latency in milliseconds.

is_error: bool

Whether the request resulted in an error.

input_tokens: Option<u32>

Input token count from the response (if available).

output_tokens: Option<u32>

Output token count from the response (if available).