Struct KvCacheStateTrace 

pub struct KvCacheStateTrace {
    pub step: usize,
    pub cache_size_bytes: usize,
    pub valid_positions: usize,
    pub max_positions: usize,
    pub evictions_this_step: usize,
    pub cache_hit_rate: f32,
    pub oldest_position: usize,
    pub fragmentation: f32,
    pub accessed_positions: Vec<usize>,
}

KV cache state at a single generation step.

Fields

step: usize

Generation step (0-indexed)

cache_size_bytes: usize

Total cache size in bytes

valid_positions: usize

Number of valid (filled) positions in cache

max_positions: usize

Maximum positions (context window size)

evictions_this_step: usize

Evictions performed this step

cache_hit_rate: f32

Cache hit rate (reused positions / total lookups)

oldest_position: usize

Oldest position still in cache

fragmentation: f32

Memory fragmentation (0.0 = compact, 1.0 = fully scattered)

accessed_positions: Vec<usize>

Positions accessed this step (for locality analysis)

Implementations

impl KvCacheStateTrace

pub fn new(step: usize, max_positions: usize) -> Self

Create a new trace for a step.

pub fn is_window_exhausted(&self) -> bool

Check if context window is exhausted.

pub fn utilization(&self) -> f32

Get cache utilization ratio.

Trait Implementations

impl Clone for KvCacheStateTrace

fn clone(&self) -> KvCacheStateTrace

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Debug for KvCacheStateTrace

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl Default for KvCacheStateTrace

fn default() -> KvCacheStateTrace

Returns the “default value” for a type.