Expand description
Provider factory — builds embedding and LLM providers from environment config.
§Provider priority (LLM and embeddings)
-
Mistral native (
MISTRAL_API_KEYset) — callsapi.mistral.aidirectly. Preferred for the European deployment stack: no Google Cloud dependency, EU-hosted, GDPR-compliant. SetMISTRAL_MODELto override the model. -
OpenAI (
OPENAI_API_KEYset) — calls OpenAI or any compatible API. Override base URL withOPENAI_API_BASEfor Ollama, Together, etc. -
Anthropic (
ANTHROPIC_API_KEYset) — callsapi.anthropic.com. LLM only (no embeddings). -
Vertex AI (
VERTEX_AI_PROJECT+ credentials set) — Google Cloud. Supports Mistral, Gemini, and Claude via Vertex Model Garden. -
Mock (fallback) — deterministic hash-based embeddings, echo LLM. Used in tests and when no cloud credentials are present.
§Environment variables
| Variable | Description | Default |
|---|---|---|
MISTRAL_API_KEY | Native Mistral API key (console.mistral.ai) | — |
MISTRAL_MODEL | Mistral model name | mistral-small-latest |
MISTRAL_EMBEDDING_MODEL | Mistral embedding model | mistral-embed |
OPENAI_API_KEY | OpenAI API key (or compatible) | — |
OPENAI_MODEL | OpenAI model name | gpt-4o-mini |
OPENAI_API_BASE | OpenAI-compatible base URL | https://api.openai.com/v1 |
OPENAI_EMBEDDING_MODEL | OpenAI embedding model | text-embedding-3-small |
ANTHROPIC_API_KEY | Anthropic API key | — |
ANTHROPIC_MODEL | Anthropic model name | claude-sonnet-4-20250514 |
VERTEX_AI_PROJECT | GCP project ID | required (or GOOGLE_CLOUD_PROJECT) |
VERTEX_AI_LOCATION | GCP region | europe-west1 (or GOOGLE_CLOUD_LOCATION) |
VERTEX_AI_TOKEN | Static GCP auth token | auto-detect |
VERTEX_AI_MODEL | Vertex model name | mistral-small-2503 |
NOETHER_LLM_PROVIDER | Force: mistral | openai | anthropic | vertex | mock | auto |
NOETHER_EMBEDDING_PROVIDER | Force: mistral | openai | vertex | mock | auto |
Functions§
- build_
embedding_ provider - Build the best available embedding provider based on env config.
- build_
llm_ provider - Build the best available LLM provider based on env config.