Struct CachedRetriever 

pub struct CachedRetriever { /* private fields */ }

A RetrieverTrait decorator backed by a SemanticCacheCore.

Query flow: embed once → lexical hit → semantic hit → miss (call inner, insert). On a hit no retrieval call (and only the embedding call) happens; the embedding itself could be skipped only for lexical hits — which skip embedding too. Failures of the inner retriever propagate (never cached).

Implementations

impl CachedRetriever

pub fn new( inner: Arc<dyn RetrieverTrait>, embeddings: Arc<dyn Embeddings>, config: SemanticCacheConfig, ) -> Self

Wraps inner with a semantic cache using config.

pub fn cache(&self) -> &Arc<SemanticCacheCore>

The underlying cache core (for inspection / invalidation).

Trait Implementations

impl Debug for CachedRetriever

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl RetrieverTrait for CachedRetriever

fn retrieve<'life0, 'life1, 'async_trait>( &'life0 self, query: &'life1 str, k: usize, ) -> Pin<Box<dyn Future<Output = Result<Vec<Document>, RetrieverError>> + Send + 'async_trait>>

where Self: 'async_trait, 'life0: 'async_trait, 'life1: 'async_trait,

Retrieves relevant documents

fn retrieve_with_scores<'life0, 'life1, 'async_trait>( &'life0 self, query: &'life1 str, k: usize, ) -> Pin<Box<dyn Future<Output = Result<Vec<SearchResult>, RetrieverError>> + Send + 'async_trait>>

where Self: 'async_trait, 'life0: 'async_trait, 'life1: 'async_trait,

Retrieves relevant documents (with scores)

fn add_documents<'life0, 'async_trait>( &'life0 self, documents: Vec<Document>, ) -> Pin<Box<dyn Future<Output = Result<(), RetrieverError>> + Send + 'async_trait>>

where Self: 'async_trait, 'life0: 'async_trait,

Adds documents