Struct VectorCache 

pub struct VectorCache { /* private fields */ }

An LRU cache for embedding vectors.

Implementations

impl VectorCache

pub fn new() -> Self

Create a new cache with default configuration.

pub fn with_config(config: VectorCacheConfig) -> Self

Create a new cache with custom configuration.

pub fn get(&mut self, key: &str) -> Option<Vec<f64>>

Get a cached vector by key.

Returns None on miss. Expired entries are evicted on access.

pub fn put(&mut self, key: impl Into<String>, vector: Vec<f64>)

Insert a vector into the cache with the default TTL.

pub fn put_with_ttl( &mut self, key: impl Into<String>, vector: Vec<f64>, ttl: Option<Duration>, )

Insert a vector with an explicit per-entry TTL.

pub fn batch_get(&mut self, keys: &[&str]) -> HashMap<String, Vec<f64>>

Batch get: returns a map of key → vector for found entries.

pub fn batch_put(&mut self, entries: Vec<(String, Vec<f64>)>)

Batch put: insert multiple entries at once.

pub fn warm(&mut self, entries: Vec<(String, Vec<f64>)>) -> usize

Warm the cache by preloading the given key-vector pairs.

Existing entries are not overwritten.

pub fn invalidate(&mut self, key: &str) -> bool

Remove a specific key from the cache.

pub fn invalidate_prefix(&mut self, prefix: &str) -> usize

Remove all keys matching a given prefix.

pub fn clear(&mut self)

Clear all entries.

pub fn statistics(&self) -> &CacheStatistics

Current cache statistics.

pub fn reset_statistics(&mut self)

Reset statistics counters to zero.

pub fn len(&self) -> usize

Number of entries currently in the cache.

pub fn is_empty(&self) -> bool

Is the cache empty?

pub fn memory_usage(&self) -> usize

Approximate total memory usage in bytes.

pub fn contains_key(&self, key: &str) -> bool

Check if a key exists in the cache (without affecting LRU order).

pub fn snapshot(&self) -> CacheSnapshot

Create a snapshot of the current cache contents.

pub fn load_snapshot(&mut self, snapshot: CacheSnapshot) -> usize

Load entries from a snapshot (appending to the current cache).

pub fn sweep_expired(&mut self) -> usize

Sweep expired entries from the cache.

Returns the number of entries removed.

Trait Implementations

impl Default for VectorCache

fn default() -> Self

Returns the “default value” for a type.