Struct OllamaProvider 

pub struct OllamaProvider { /* private fields */ }

Ollama provider for local models (Llama, Mistral, …).

Implementations

impl OllamaProvider

pub fn new() -> OllamaProvider

Construct against the default local server (http://localhost:11434).

pub fn from_env() -> OllamaProvider

Construct from the OLLAMA_HOST environment variable, if set.

pub fn model(self, model: impl Into<String>) -> OllamaProvider

Set the default model.

pub fn base_url(self, base_url: impl Into<String>) -> OllamaProvider

Override the base URL.

pub fn with_client(self, client: Client) -> OllamaProvider

Provide a custom reqwest::Client.

Trait Implementations

impl Clone for OllamaProvider

fn clone(&self) -> OllamaProvider

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Default for OllamaProvider

fn default() -> OllamaProvider

Returns the “default value” for a type.

impl LlmProvider for OllamaProvider

fn chat<'life0, 'async_trait>( &'life0 self, req: ChatRequest, ) -> Pin<Box<dyn Future<Output = Result<ChatResponse, LlmError>> + Send + 'async_trait>>

where 'life0: 'async_trait, OllamaProvider: 'async_trait,

Single-shot chat completion.

fn chat_stream<'life0, 'async_trait>( &'life0 self, req: ChatRequest, ) -> Pin<Box<dyn Future<Output = Result<Pin<Box<dyn Stream<Item = Result<StreamDelta, LlmError>> + Send>>, LlmError>> + Send + 'async_trait>>

where 'life0: 'async_trait, OllamaProvider: 'async_trait,

Streaming chat completion.

fn embed<'life0, 'async_trait>( &'life0 self, req: EmbedRequest, ) -> Pin<Box<dyn Future<Output = Result<EmbedResponse, LlmError>> + Send + 'async_trait>>

where 'life0: 'async_trait, OllamaProvider: 'async_trait,

Generate embeddings.

fn name(&self) -> &'static str

Provider name (“openai” | “anthropic” | “ollama”).

fn model(&self) -> &str

Active default model slug.

fn estimate_cost(&self, _req: &ChatRequest) -> Option<CostEstimate>

Pre-flight cost estimate (no network call). None if unknown.