Skip to main content

select_backend

inference::backend

Function select_backend 

Source 
pub async fn select_backend(
    config: &ModelConfig,
) -> Result<Arc<dyn EmbeddingBackend>>
Expand description

Select an embedding backend based on environment variables.

Priority:

  1. DAKERA_BACKEND — explicit backend selection
  2. DAKERA_USE_GPU=1 → Candle (CUDA/Metal) when the candle feature is compiled in
  3. Default → OnnxBackend

§Errors

Returns an error if the requested backend is not compiled in or fails to initialise.