Struct L3SemanticCache 

pub struct L3SemanticCache { /* private fields */ }

L3 semantic cache (vector similarity)

This cache stores query embeddings and uses cosine similarity to find matches even when queries are not identical.

Implementations

impl L3SemanticCache

pub fn new(config: L3Config) -> Self

Create a new L3 semantic cache

pub async fn get( &self, query: &str, context: &CacheContext, ) -> Option<CachedResult>

Look up a query using semantic similarity

pub async fn put( &self, query: &str, context: &CacheContext, result: CachedResult, )

Store a query and result in the semantic cache

pub async fn clear(&self)

Clear all entries

pub fn len(&self) -> usize

Get entry count

pub fn is_empty(&self) -> bool

Check if cache is empty

pub fn stats(&self) -> L3CacheStats

Get cache statistics

pub async fn health_check(&self) -> bool

Check if the embedding service is available

Trait Implementations

impl Debug for L3SemanticCache

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.