Struct ExpertCacheStats 

pub struct ExpertCacheStats {
    pub calls: u64,
    pub active: u64,
    pub missing: u64,
    pub fetched: u64,
}

Running counters, for /metrics and for deciding whether the cache is sized right.

Fields

calls: u64

ensure calls.

active: u64

Distinct experts routed to, summed over calls.

missing: u64

Distinct misses, summed over calls, before any cap.

fetched: u64

Misses actually fetched, summed over calls.

Implementations

impl ExpertCacheStats

pub fn miss_rate(&self) -> f64

Fraction of routed experts that were not resident. The number that says whether the cache is big enough.

pub fn fetch_rate(&self) -> f64

Fraction of misses served over the link rather than by the CPU. The number that says what the q* split actually did.

pub fn active_per_call(&self) -> f64

pub fn missing_per_call(&self) -> f64

Misses per call, before the cap. Quoted beside active_per_call because the pair is what sizes a link budget: missing_per_call * bytes_per_expert is what one step wants to move.

pub fn fetched_per_call(&self) -> f64

Misses per call that actually crossed the link. Under the q* split this is the one the link sees; missing_per_call minus this is what the CPU absorbed.

Trait Implementations

impl Clone for ExpertCacheStats

fn clone(&self) -> ExpertCacheStats

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Copy for ExpertCacheStats

impl Debug for ExpertCacheStats

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl Default for ExpertCacheStats

fn default() -> ExpertCacheStats

Returns the “default value” for a type.

impl Eq for ExpertCacheStats

impl PartialEq for ExpertCacheStats

fn eq(&self, other: &ExpertCacheStats) -> bool

Equality operator ==.

fn ne(&self, other: &Rhs) -> bool

Inequality operator !=.

impl StructuralPartialEq for ExpertCacheStats