Struct ChatDecoder 

pub struct ChatDecoder { /* private fields */ }

Decode native Ollama chat replies.

thinking and content each continue the block of the record before while the kind stays the same, and each call is a whole block. The reply ends at the record that says done; its done_reason is the finish reason, tool_calls when a stop reply called a tool, and its prompt_eval_count, prompt_eval_cached_count (the part of the prompt read from the daemon’s cache) and eval_count are the usage.

A reply with no thinking whose content, after leading whitespace, starts with <think> has that block split out as reasoning, by its tags alone. Content is held only while its start could still become <think>; content that cannot is text at once. Inside the block, reasoning streams as it arrives, holding back only trailing whitespace and a partial </think>. After </think> the rest is text. A block that never closes is reasoning to the end of the reply.

Trait Implementations

impl Debug for ChatDecoder

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl<'id> Decoder<'id, Completion> for ChatDecoder

fn decode( &mut self, ChatRecord: ChatRecord, out: Out<'id, Completion>, ) -> Result<Flow, ProviderError>

Fields are read leniently: one the record leaves out or sends with another type is absent, so only error and done steer the reply.

type Event = ChatRecord

The wire’s typed event, produced by this decoder’s classifier.

fn classify(&self, frame: WireFrame) -> WireEvent<ChatRecord>

Decode and classify one frame. A JSON wire MUST delegate to a classifier in crate::providers::internal::wire, so the decode-then-validate policy is not re-derived per provider.

fn eof(&mut self, out: Out<'id, Op>) -> Result<Flow, ProviderError>

The frames ran out without an end. A decoder that already saw the provider’s end, in a form the provider sends before its last frame, ends the reply here; otherwise the reply is truncated.

impl Default for ChatDecoder

fn default() -> Self

Returns the “default value” for a type.