Struct SemanticCache 

pub struct SemanticCache { /* private fields */ }

The cache itself. Cloning shares state via the inner Arc.

Implementations

impl SemanticCache

pub fn new(config: SemanticCacheConfig) -> SemanticCache

Build an in-process cache with no durable backend.

pub fn with_backend( config: SemanticCacheConfig, backend: Arc<dyn MlPersistence>, ) -> SemanticCache

Build a cache that persists every mutation to backend under cache:{namespace}. Entries rehydrate on construction.

pub fn load_from_backend(&self) -> Result<usize, MlPersistenceError>

Re-read persisted entries into memory. Malformed rows are skipped rather than crashing startup.

pub fn lookup(&self, embedding: &[f32]) -> Option<String>

Look up by embedding. Returns the cached response on hit; updates last_hit_ms and hit counter as a side-effect.

pub fn insert( &self, prompt: impl Into<String>, response: impl Into<String>, embedding: Vec<f32>, ttl_ms_override: Option<u64>, )

Insert (prompt, response) keyed by embedding. If ttl_ms_override is None the config default applies.

pub fn evict_expired(&self) -> usize

Manually force a sweep. Returns number of entries dropped.

pub fn stats(&self) -> SemanticCacheStats

Snapshot of counters.

pub fn config(&self) -> &SemanticCacheConfig

Trait Implementations

impl Clone for SemanticCache

fn clone(&self) -> SemanticCache

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Debug for SemanticCache

fn fmt(&self, f: &mut Formatter<'_>) -> Result<(), Error>

Formats the value using the given formatter.