Struct LLMEmbedder 

pub struct LLMEmbedder { /* private fields */ }

Embedder wrapper that uses an LLMBackend for embeddings

Implementations

impl LLMEmbedder

pub fn new(backend: Arc<dyn LLMBackend>, dimension: usize) -> Self

Create a new LLM-based embedder

Common dimensions:

• OpenAI text-embedding-3-small: 1536
• OpenAI text-embedding-3-large: 3072
• OpenAI text-embedding-ada-002: 1536

pub fn openai_small(backend: Arc<dyn LLMBackend>) -> Self

Create embedder for OpenAI text-embedding-3-small (1536 dimensions)

pub fn openai_large(backend: Arc<dyn LLMBackend>) -> Self

Create embedder for OpenAI text-embedding-3-large (3072 dimensions)

Trait Implementations

impl Embedder for LLMEmbedder

fn embed<'life0, 'life1, 'async_trait>( &'life0 self, text: &'life1 str, ) -> Pin<Box<dyn Future<Output = Result<Vec<f32>, MemoryError>> + Send + 'async_trait>>

where Self: 'async_trait, 'life0: 'async_trait, 'life1: 'async_trait,

Generate embedding for text

fn dimension(&self) -> usize

Get embedding dimension

fn embed_batch<'life0, 'life1, 'life2, 'async_trait>( &'life0 self, texts: &'life1 [&'life2 str], ) -> Pin<Box<dyn Future<Output = Result<Vec<Vec<f32>>, MemoryError>> + Send + 'async_trait>>

where Self: 'async_trait, 'life0: 'async_trait, 'life1: 'async_trait, 'life2: 'async_trait,

Generate embeddings for multiple texts (batch)