Skip to main content

Crate llmkit_ollama

Crate llmkit_ollama 

Source
Expand description

Ollama provider adapter for llmkit-rs.

Implements llmkit_core::LlmProvider against a local Ollama server (/api/chat, /api/embed) with NDJSON streaming.

use llmkit_ollama::OllamaProvider;
use llmkit_core::{LlmProvider, ChatRequest};

let provider = OllamaProvider::new().model("llama3.1");
let resp = provider.chat(ChatRequest::builder().user("Hello!").build()).await?;
println!("{}", resp.text().unwrap_or_default());

Structs§

OllamaProvider
Ollama provider for local models (Llama, Mistral, …).