Struct HotEmbeddingCache 

pub struct HotEmbeddingCache { /* private fields */ }

Hot embedding cache with LRU eviction and adaptive sizing

Caches frequently accessed embeddings in memory with cache-aligned storage for optimal SIMD performance.

Implementations

impl HotEmbeddingCache

pub fn new(capacity: usize) -> Self

Create a new hot embedding cache

pub fn get(&self, key: &str) -> Option<AlignedVector>

Get an embedding from the cache

pub fn insert(&self, key: String, vector: Vec<f32>)

Insert an embedding into the cache

pub fn stats(&self) -> HotCacheStats

Get cache statistics

pub fn clear(&self)

Clear the cache

pub fn len(&self) -> usize

Get the current size of the cache

pub fn is_empty(&self) -> bool

Check if the cache is empty

pub fn prefetch(&self, keys: Vec<String>)

Prefetch embeddings (add to prefetch queue)

pub fn get_hot_keys(&self, top_n: usize) -> Vec<String>

Get hot embeddings (most frequently accessed)