Skip to main content

LocalEmbeddingBackend

reddb_server::runtime::ai::local_embedding

Trait LocalEmbeddingBackend 

Source 
pub trait LocalEmbeddingBackend: Send + Sync {
    // Required method
    fn embed(
        &self,
        request: &LocalEmbeddingRequest,
    ) -> RedDBResult<Vec<Vec<f32>>>;
}
Expand description

Backend abstraction so HTTP/gRPC routing does not depend on a specific model engine. A future candle/onnx backend implements this trait and is installed via install_local_embedding_backend.

Required Methods§

Source

fn embed(&self, request: &LocalEmbeddingRequest) -> RedDBResult<Vec<Vec<f32>>>

Dyn Compatibility§

This trait is dyn compatible.

In older versions of Rust, dyn compatibility was called "object safety".

Implementors§