Struct EmbeddingCache 

pub struct EmbeddingCache {
    pub inner: LruCache<String, Vec<f32>>,
    pub hit_count: u64,
    pub miss_count: u64,
}

LRU cache for embedding vectors keyed by a SHA-256 hash of the input text.

Fields

inner: LruCache<String, Vec<f32>>

Inner LRU cache mapping text digests to embeddings.

hit_count: u64

Number of cache hits.

miss_count: u64

Number of cache misses.

Implementations

impl EmbeddingCache

pub fn new(capacity: usize) -> Self

Create a new cache with the given maximum capacity.

pub fn key(text: &str) -> String

Compute the cache key for an input text.

pub fn get(&mut self, text: &str) -> Option<Vec<f32>>

Look up a cached vector for text, returning None on a cache miss.

pub fn insert(&mut self, text: &str, vector: Vec<f32>)

Insert or update a cached vector for text.

pub fn stats(&self) -> EmbeddingCacheStats

Return a snapshot of cache hit/miss counts and entry count.