Struct OllamaDriver 

pub struct OllamaDriver { /* private fields */ }

Driver for local Ollama instances using the chat API.

Implementations

impl OllamaDriver

pub fn new(base_url: Option<String>) -> Self

Create a new Ollama driver.

pub fn with_client(client: Client, base_url: Option<String>) -> Self

Create a new Ollama driver with a shared HTTP client.

pub fn base_url(&self) -> &str

Get the base URL.

pub fn build_request_body(&self, request: &CompletionRequest) -> Value

Build the Ollama chat request body.

pub fn parse_response(&self, body: &Value) -> PunchResult<CompletionResponse>

Parse the Ollama chat response.

Trait Implementations

impl LlmDriver for OllamaDriver

fn complete<'life0, 'async_trait>( &'life0 self, request: CompletionRequest, ) -> Pin<Box<dyn Future<Output = PunchResult<CompletionResponse>> + Send + 'async_trait>>

where Self: 'async_trait, 'life0: 'async_trait,

Send a completion request and return the response.

fn stream_complete<'life0, 'async_trait>( &'life0 self, request: CompletionRequest, ) -> Pin<Box<dyn Future<Output = PunchResult<CompletionResponse>> + Send + 'async_trait>>

where Self: 'async_trait, 'life0: 'async_trait,

Streaming variant. Default implementation falls back to complete.