Struct CacheBackedEmbeddings 

pub struct CacheBackedEmbeddings { /* private fields */ }

An embeddings wrapper that caches results in memory.

Previously computed embeddings are stored in an in-memory hash map keyed by the input text. On subsequent calls, cached embeddings are returned directly, and only uncached texts are sent to the inner embeddings provider.

Implementations

impl CacheBackedEmbeddings

pub fn new(inner: Arc<dyn Embeddings>) -> Self

Create a new cached embeddings wrapper around the given embeddings provider.

Trait Implementations

impl Embeddings for CacheBackedEmbeddings

fn embed_documents<'life0, 'life1, 'life2, 'async_trait>( &'life0 self, texts: &'life1 [&'life2 str], ) -> Pin<Box<dyn Future<Output = Result<Vec<Vec<f32>>, SynapseError>> + Send + 'async_trait>>

where Self: 'async_trait, 'life0: 'async_trait, 'life1: 'async_trait, 'life2: 'async_trait,

Embed multiple texts (for batch document embedding).

fn embed_query<'life0, 'life1, 'async_trait>( &'life0 self, text: &'life1 str, ) -> Pin<Box<dyn Future<Output = Result<Vec<f32>, SynapseError>> + Send + 'async_trait>>

where Self: 'async_trait, 'life0: 'async_trait, 'life1: 'async_trait,

Embed a single query text.