Skip to main content

LocalEmbeddingBackend

reddb::runtime::ai::local_embedding

Trait LocalEmbeddingBackend 

Source 
pub trait LocalEmbeddingBackend: Send + Sync {
    // Required method
    fn embed(
        &self,
        request: &LocalEmbeddingRequest,
    ) -> Result<Vec<Vec<f32>>, RedDBError>;
}
Expand description

Backend abstraction so HTTP/gRPC routing does not depend on a specific model engine. A future candle/onnx backend implements this trait and is installed via install_local_embedding_backend.

Required Methods§

Source

fn embed( &self, request: &LocalEmbeddingRequest, ) -> Result<Vec<Vec<f32>>, RedDBError>

Dyn Compatibility§

This trait is dyn compatible.

In older versions of Rust, dyn compatibility was called "object safety".

Implementors§