Struct MemoryBoundedCache 

pub struct MemoryBoundedCache { /* private fields */ }

An EmbeddingCache variant that evicts entries when total memory exceeds a byte limit.

Implementations

impl MemoryBoundedCache

pub fn new(max_bytes: usize) -> Self

Create a memory-bounded cache with a maximum of max_bytes.

The internal entry capacity is set to a generous upper bound so that the byte limit is always the binding constraint.

pub fn insert(&mut self, key: CacheKey, embedding: Vec<f32>)

Insert an embedding, evicting LRU entries until within the memory limit.

pub fn get(&mut self, key: &CacheKey) -> Option<&[f32]>

Delegate to inner cache.

pub fn total_size_bytes(&self) -> usize

Current byte usage.

pub fn max_bytes(&self) -> usize

Maximum byte limit.

pub fn stats(&self) -> CacheStats

Statistics.

pub fn len(&self) -> usize

Number of entries.

pub fn is_empty(&self) -> bool

True when empty.