Struct EmbeddingCache 

pub struct EmbeddingCache { /* private fields */ }

LRU cache for embedding vectors, keyed by hash of (model_name + text).

Implementations

impl EmbeddingCache

pub fn new(max_size: usize) -> Self

Create a new cache with the given maximum number of entries.

pub fn default_size() -> Self

Create a cache with the default size of 10,000 entries.

pub fn get(&mut self, text: &str, model: &str) -> Option<&[f32]>

Look up a cached embedding. Returns None on cache miss.

pub fn put(&mut self, text: &str, model: &str, embedding: Vec<f32>)

Insert an embedding into the cache. Evicts the LRU entry if full.

pub fn stats(&self) -> CacheStats

Get cache statistics.

pub fn clear(&mut self)

Clear all cached entries.