Struct EmbeddingCache 

pub struct EmbeddingCache { /* private fields */ }

LRU embedding cache with a fixed entry-count capacity.

Implementations

impl EmbeddingCache

pub fn new(capacity: usize) -> Self

Create a cache that holds at most capacity embeddings.

Capacity is clamped to at least 1.

pub fn get(&mut self, key: &CacheKey) -> Option<&[f32]>

Look up an embedding. Promotes the entry to MRU on hit.

pub fn insert(&mut self, key: CacheKey, embedding: Vec<f32>)

Insert an embedding. Evicts the LRU entry when at capacity.

pub fn evict_lru(&mut self) -> Option<(CacheKey, CacheEntry)>

Manually evict the LRU entry.

pub fn invalidate(&mut self, key: &CacheKey) -> bool

Remove a specific entry. Returns true if it was present.

pub fn invalidate_model(&mut self, model_id: &str) -> usize

Remove all entries for a given model.

pub fn stats(&self) -> CacheStats

Current statistics snapshot.

pub fn len(&self) -> usize

Number of entries currently in the cache.

pub fn is_empty(&self) -> bool

true when the cache is empty.

pub fn capacity(&self) -> usize

Maximum entry capacity.