Struct CandleEmbeddingEngine 

pub struct CandleEmbeddingEngine { /* private fields */ }

Pure-Rust embedding engine using candle for BERT inference.

Uses candle-transformers’ BERT implementation with tokenizers for tokenisation. No C/C++ FFI dependencies — compiles on all platforms.

Implementations

impl CandleEmbeddingEngine

pub fn new() -> Result<Self, MemoryError>

Initialise the candle embedding engine.

Downloads model weights from HuggingFace Hub on first use (cached in the standard HF cache directory, respects HF_HOME).

Trait Implementations

impl EmbeddingBackend for CandleEmbeddingEngine

fn embed<'life0, 'life1, 'async_trait>( &'life0 self, texts: &'life1 [String], ) -> Pin<Box<dyn Future<Output = Result<Vec<Vec<f32>>, MemoryError>> + Send + 'async_trait>>

where Self: 'async_trait, 'life0: 'async_trait, 'life1: 'async_trait,

Embed a batch of texts, returning one vector per input.

fn dimensions(&self) -> usize

Number of dimensions produced by the model.

fn embed_one<'life0, 'life1, 'async_trait>( &'life0 self, text: &'life1 str, ) -> Pin<Box<dyn Future<Output = Result<Vec<f32>, MemoryError>> + Send + 'async_trait>>

where Self: 'async_trait, 'life0: 'async_trait, 'life1: 'async_trait,

Convenience: embed a single text.