Struct EmbeddingMiddleware 

pub struct EmbeddingMiddleware<P: EmbeddingProvider> { /* private fields */ }

Embedding generation middleware

This struct provides pre-processing and post-processing for embedding requests, such as:

• Text normalization
• Embedding caching
• Batch processing optimization
• Vector normalization

Implementations

impl<P: EmbeddingProvider> EmbeddingMiddleware<P>

pub fn new(provider: P, normalize_vectors: bool) -> Self

Create a new embedding middleware instance

pub fn initialize_tokenizer() -> Result<()>

Initialize tokenizer

pub fn normalize_text(&self, text: &str) -> String

Normalize text content

pub fn normalize_vector(&self, vector: &mut [f32])

Normalize vector to make it a unit vector

Trait Implementations

impl<P: EmbeddingProvider + Send + Sync> EmbeddingProvider for EmbeddingMiddleware<P>

fn generate_embedding<'life0, 'life1, 'async_trait>( &'life0 self, text: &'life1 str, ) -> Pin<Box<dyn Future<Output = Result<Vec<f32>>> + Send + 'async_trait>>

where Self: 'async_trait, 'life0: 'async_trait, 'life1: 'async_trait,

Generate embedding vector for a single text

fn generate_embeddings<'life0, 'async_trait>( &'life0 self, texts: Vec<String>, ) -> Pin<Box<dyn Future<Output = Result<Vec<Vec<f32>>>> + Send + 'async_trait>>

where Self: 'async_trait, 'life0: 'async_trait,

Generate embedding vectors for multiple texts

fn count_tokens(&self, text: &str) -> Result<usize>

Count tokens in text