Struct OllamaConfig 

pub struct OllamaConfig {
    pub base_url: String,
    pub default_model: String,
    pub max_context_tokens: usize,
    pub retry_policy: RetryPolicy,
}

Configuration for Ollama local models.

Ollama is a tool for running open-source LLMs locally. It provides an OpenAI-compatible API and doesn’t require an API key.

Example

use multi_llm::OllamaConfig;

let config = OllamaConfig {
    base_url: "http://localhost:11434".to_string(),
    default_model: "llama2".to_string(),
    max_context_tokens: 4096,
    ..Default::default()
};

Environment Variables

None required (local service).

Popular Models

• llama2: Meta’s Llama 2
• mistral: Mistral AI’s model
• codellama: Code-specialized Llama
• phi: Microsoft’s Phi model

Install models with: ollama pull <model-name>

Fields

base_url: String

Base URL for the Ollama server (default: http://localhost:11434).

default_model: String

Default model to use (must be pulled with ollama pull).

max_context_tokens: usize

Maximum context window size (depends on model).

retry_policy: RetryPolicy

Retry policy for transient failures.

Trait Implementations

impl Clone for OllamaConfig

fn clone(&self) -> OllamaConfig

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Debug for OllamaConfig

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl Default for OllamaConfig

fn default() -> Self

Returns the “default value” for a type.

impl<'de> Deserialize<'de> for OllamaConfig

fn deserialize<__D>(__deserializer: __D) -> Result<Self, __D::Error>

where __D: Deserializer<'de>,

Deserialize this value from the given Serde deserializer.

impl ProviderConfig for OllamaConfig

fn provider_name(&self) -> &'static str

Get the provider identifier (e.g., “openai”, “anthropic”).

fn max_context_tokens(&self) -> usize

Get the maximum context window size in tokens.

fn validate(&self) -> LlmResult<()>

Validate that the configuration is complete and valid.

fn base_url(&self) -> &str

Get the base URL for API requests.

fn api_key(&self) -> Option<&str>

Get the API key, if one is configured.

fn default_model(&self) -> &str

Get the default model name for this provider.

fn as_any(&self) -> &dyn Any

Downcast helper for accessing concrete config types.

fn retry_policy(&self) -> &RetryPolicy

Get the retry policy for transient failures.

impl Serialize for OllamaConfig

fn serialize<__S>(&self, __serializer: __S) -> Result<__S::Ok, __S::Error>

where __S: Serializer,

Serialize this value into the given Serde serializer.