Struct EngineStats 

pub struct EngineStats {
    pub total_tokens_generated: AtomicU64,
    pub total_requests: AtomicU64,
    pub active_sessions: AtomicUsize,
    pub start_time: Instant,
}

Statistics about engine usage, accumulated over the engine’s lifetime.

Fields

total_tokens_generated: AtomicU64

Total number of tokens generated.

total_requests: AtomicU64

Total number of inference requests completed.

active_sessions: AtomicUsize

Number of currently active sessions.

start_time: Instant

Engine start time.

Implementations

impl EngineStats

pub fn new() -> Self

Create new engine stats, recording the current time as start.

pub fn uptime_seconds(&self) -> f64

Engine uptime in seconds.

pub fn record_request(&self, tokens_generated: usize)

Record that a request completed with the given number of generated tokens.

pub fn tokens_generated(&self) -> u64

Get total tokens generated.

pub fn requests_completed(&self) -> u64

Get total requests completed.

pub fn active_session_count(&self) -> usize

Get number of active sessions.

pub fn avg_tokens_per_request(&self) -> f64

Average tokens per request (returns 0.0 if no requests).

Trait Implementations

impl Debug for EngineStats

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl Default for EngineStats

fn default() -> Self

Returns the “default value” for a type.