Struct OllamaProvider 

pub struct OllamaProvider { /* private fields */ }

Ollama provider implementing Provider.

Connects to a locally running Ollama instance. No authentication is required by default.

Example

use llm_stack_ollama::{OllamaConfig, OllamaProvider};
use llm_stack::{ChatParams, ChatMessage, Provider};

let provider = OllamaProvider::new(OllamaConfig::default());

let response = provider.generate(&ChatParams {
    messages: vec![ChatMessage::user("Hello!")],
    ..Default::default()
}).await?;

Implementations

impl OllamaProvider

pub fn new(config: OllamaConfig) -> Self

Create a new Ollama provider from configuration.

If config.client is Some, that client is reused for connection pooling. Otherwise a new client is built with the configured timeout.

Trait Implementations

impl Debug for OllamaProvider

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl Provider for OllamaProvider

async fn generate(&self, params: &ChatParams) -> Result<ChatResponse, LlmError>

Sends a chat completion request and returns the full response.

async fn stream(&self, params: &ChatParams) -> Result<ChatStream, LlmError>

Sends a chat completion request and returns a stream of events.

fn metadata(&self) -> ProviderMetadata

Returns static metadata describing this provider instance.