Struct CacheEntryScorer 

pub struct CacheEntryScorer { /* private fields */ }

Scores importance of KV cache entries

Implementations

impl CacheEntryScorer

pub fn new(config: CacheScoringConfig) -> Self

Create a new cache entry scorer

pub fn score_entry(&self, params: CacheEntryParams<'_>) -> f32

Score a KV cache entry based on various factors

pub fn update_engagement(&mut self, key_hash: &str, was_retrieved: bool)

pub fn should_preserve_entry( &self, importance_score: f32, key_type: &str, layer_index: i32, config_threshold: f32, ) -> bool

Determine if an entry should be preserved during cache clearing

pub fn extract_keywords(&self, key_data: Option<&[u8]>) -> Vec<String>

Extract keywords from a key for retrieval

Trait Implementations

impl CacheEntryScorer for CacheEntryScorer

Implementation of the trait required by the cache_extractor module

fn extract_keywords(&self, key_data: Option<&[u8]>) -> Vec<String>