Enum ProviderConfig 

#[non_exhaustive]
pub enum ProviderConfig {
    OpenAI {
        api_key_env: String,
        api_base: String,
        default_model: String,
    },
    Azure {
        api_key_env: String,
        base_url_env: String,
        default_model: String,
    },
    Anthropic {
        api_key_env: String,
        default_model: String,
    },
    Bedrock {
        api_key_env: String,
        region_env: String,
        default_model: String,
    },
    Ollama {
        api_key_env: String,
        base_url: String,
        default_model: String,
    },
}

LLM provider configuration.

openai covers the OpenAI API and OpenAI-compatible endpoints (NVIDIA NIM, Groq, Azure OpenAI, local vLLM, etc.).

azure covers Azure AI Foundry’s OpenAI-compatible /openai/v1 endpoints while reading both the API key and base URL from environment variables.

bedrock requires the bedrock feature on ares-llm. anthropic requires the anthropic feature on ares-llm. ollama requires the ollama feature. These are compiled out of the default production build (--no-default-features --features openai,postgres,mcp), so they are not present in ares-server binaries that omit those features. The ares.toml schema is the same regardless: the runtime Provider::from_config_with_params returns a clear configuration error when a variant is selected without the corresponding feature enabled.

Variants (Non-exhaustive)

Non-exhaustive enums could have additional variants added in future. Therefore, when matching against variants of non-exhaustive enums, an extra wildcard arm must be added to account for any future variants.

OpenAI

OpenAI API (or compatible endpoints, including NVIDIA NIM).

Fields

api_key_env: String

Environment variable containing API key.

api_base: String

API base URL (default: https://api.openai.com/v1).

default_model: String

Default model to use with this provider.

Azure

Azure AI Foundry OpenAI-compatible chat completions.

Fields

api_key_env: String

Environment variable containing the Foundry API key.

base_url_env: String

Environment variable containing the Foundry base URL.

default_model: String

Default Foundry model id.

Anthropic

Anthropic Claude API.

Fields

api_key_env: String

Environment variable containing API key (default: ANTHROPIC_API_KEY).

default_model: String

Default model (default: claude-3-5-sonnet-20241022).

Bedrock

AWS Bedrock Claude API.

Fields

api_key_env: String

Environment variable containing the Bedrock bearer token.

region_env: String

Environment variable containing the AWS region.

default_model: String

Default Bedrock model id.

Ollama

Local Ollama server. The api_key_env is a dummy field (Ollama does not require authentication) so the same fleet-secrets storage layer can be used uniformly for all providers.

Fields

api_key_env: String

Dummy env var; unused at runtime.

base_url: String

Base URL of the Ollama server.

default_model: String

Default model id (e.g. ministral-3:3b).

Implementations

impl ProviderConfig

pub fn type_name(&self) -> &'static str

Returns the provider type discriminator.

Trait Implementations

impl Clone for ProviderConfig

fn clone(&self) -> ProviderConfig

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Debug for ProviderConfig

fn fmt(&self, f: &mut Formatter<'_>) -> Result<(), Error>

Formats the value using the given formatter.

impl<'de> Deserialize<'de> for ProviderConfig

fn deserialize<__D>( __deserializer: __D, ) -> Result<ProviderConfig, <__D as Deserializer<'de>>::Error>

where __D: Deserializer<'de>,

Deserialize this value from the given Serde deserializer.

impl FromStr for ProviderConfig

fn from_str(s: &str) -> Result<ProviderConfig, <ProviderConfig as FromStr>::Err>

Parse a provider type name into a default ProviderConfig variant. Accepts openai (and the nvidia alias), azure, anthropic, bedrock, and ollama.

type Err = String

The associated error which can be returned from parsing.

impl Serialize for ProviderConfig

fn serialize<__S>( &self, __serializer: __S, ) -> Result<<__S as Serializer>::Ok, <__S as Serializer>::Error>

where __S: Serializer,

Serialize this value into the given Serde serializer.