Struct BatchEmbeddingProvider 

pub struct BatchEmbeddingProvider { /* private fields */ }

Wraps any EmbeddingProvider to expose a convenience batch method.

Delegates to the inner provider’s embed_batch (which by default calls embed sequentially). Providers that support native batching can override embed_batch on the trait for better performance.

Implementations

impl BatchEmbeddingProvider

pub fn new(inner: Arc<dyn EmbeddingProvider>) -> Self

Wrap an existing provider for batch operations.

pub async fn embed_batch(&self, texts: &[&str]) -> ArgentorResult<Vec<Vec<f32>>>

Embed multiple texts, returning one vector per input.

Trait Implementations

impl EmbeddingProvider for BatchEmbeddingProvider

fn embed<'life0, 'life1, 'async_trait>( &'life0 self, text: &'life1 str, ) -> Pin<Box<dyn Future<Output = ArgentorResult<Vec<f32>>> + Send + 'async_trait>>

where Self: 'async_trait, 'life0: 'async_trait, 'life1: 'async_trait,

Compute embedding vector for a single text.

fn embed_batch<'life0, 'life1, 'life2, 'async_trait>( &'life0 self, texts: &'life1 [&'life2 str], ) -> Pin<Box<dyn Future<Output = ArgentorResult<Vec<Vec<f32>>>> + Send + 'async_trait>>

where Self: 'async_trait, 'life0: 'async_trait, 'life1: 'async_trait, 'life2: 'async_trait,

Compute embeddings for a batch of texts.

fn dimension(&self) -> usize

Dimension of the embedding vectors produced by this provider.