Struct ModelCacheStats 

pub struct ModelCacheStats {
    pub cached_models: usize,
    pub total_hits: u64,
    pub total_misses: u64,
    pub hit_rate: f32,
    pub total_memory_bytes: usize,
    pub oldest_entry_age_secs: Option<u64>,
}

Snapshot of cache utilisation metrics, suitable for serialisation to JSON.

Fields

cached_models: usize

Number of entries currently held in the cache.

total_hits: u64

Cumulative cache hits since the cache was created.

total_misses: u64

Cumulative cache misses since the cache was created.

hit_rate: f32

Hit rate as a fraction in [0.0, 1.0].

total_memory_bytes: usize

Sum of memory_bytes across all cached entries.

oldest_entry_age_secs: Option<u64>

Age in seconds of the oldest entry, or None if the cache is empty.

Trait Implementations

impl Debug for ModelCacheStats

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl Serialize for ModelCacheStats

fn serialize<__S>(&self, __serializer: __S) -> Result<__S::Ok, __S::Error>

where __S: Serializer,

Serialize this value into the given Serde serializer.