Struct GatewayEmbedder 

pub struct GatewayEmbedder { /* private fields */ }

OpenAI-compatible /v1/embeddings embedder (the SmooAI LiteLLM gateway).

Only used when explicitly configured. Reads the endpoint from SMOOAI_GATEWAY_URL and the key from SMOOAI_GATEWAY_KEY (or pass them in). The default model is text-embedding-3-small (1536-d) — set the adapter dimension to OPENAI_SMALL_EMBEDDING_DIM when using it.

Implementations

impl GatewayEmbedder

pub fn new( base_url: impl Into<String>, api_key: impl Into<String>, model: impl Into<String>, dim: usize, ) -> Self

Build from explicit config.

pub fn from_env() -> Result<Self>

Build from SMOOAI_GATEWAY_URL + SMOOAI_GATEWAY_KEY, defaulting the model to text-embedding-3-small and the dimension to 1536.

Errors

Returns an error if either environment variable is unset.

Trait Implementations

impl Clone for GatewayEmbedder

fn clone(&self) -> GatewayEmbedder

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Embedder for GatewayEmbedder

fn dim(&self) -> usize

The fixed output dimension. Must equal the vector(N) column width.

fn embed<'life0, 'life1, 'async_trait>( &'life0 self, texts: &'life1 [String], _input_type: InputType, ) -> Pin<Box<dyn Future<Output = Result<Vec<Vec<f32>>>> + Send + 'async_trait>>

where Self: 'async_trait, 'life0: 'async_trait, 'life1: 'async_trait,

Embed a batch of texts. Returns texts.len() vectors, each dim() long.