Expand description
Ollama provider adapter for llmkit-rs.
Implements llmkit_core::LlmProvider against a local Ollama server
(/api/chat, /api/embed) with NDJSON streaming.
use llmkit_ollama::OllamaProvider;
use llmkit_core::{LlmProvider, ChatRequest};
let provider = OllamaProvider::new().model("llama3.1");
let resp = provider.chat(ChatRequest::builder().user("Hello!").build()).await?;
println!("{}", resp.text().unwrap_or_default());Structs§
- Ollama
Provider - Ollama provider for local models (Llama, Mistral, …).