Skip to main content

Module providers

Module providers 

Source
Expand description

Built-in LLM provider implementations.

Each submodule implements StreamingModelProvider and ProviderFactory for a specific LLM service.

§Available providers

ModuleProviderEnv varFeature flag
anthropicAnthropic (Claude)ANTHROPIC_API_KEY
openaiOpenAI (GPT)OPENAI_API_KEY
openrouterOpenRouterOPENROUTER_API_KEY
geminiGoogle GeminiGEMINI_API_KEY
local::ollamaOllama– (local)
local::llama_cppllama.cpp– (local)
openai_compatibleDeepSeek, ZAI, Moonshotvaries
bedrockAWS BedrockAWS credentialsbedrock
codexOpenAI Codex (OAuth)– (OAuth)codex

§OpenAI-compatible providers

The openai_compatible module provides a shared GenericOpenAiProvider that works with any OpenAI-compatible API. DeepSeek, ZAI, and Moonshot use this with pre-configured ProviderConfig constants.

§Adding a new provider

  1. Create a submodule under providers/.
  2. Implement StreamingModelProvider and ProviderFactory.
  3. Register it in ModelProviderParser::default().
  4. Add model entries to models.json for the catalog.

Modules§

anthropic
Anthropic LLM provider.
bedrock
AWS Bedrock LLM provider.
codex
Codex LLM provider.
gemini
Gemini LLM provider.
local
Local LLM providers.
openai
OpenAI LLM provider.
openai_compatible
OpenAI-compatible LLM providers.
openrouter
OpenRouter LLM provider.