Skip to main content

Module client

Module client 

Source
Expand description

OpenAI-compatible client with raw capture and streaming reassembly.

Structs§

Client
Exchange
One request and what came back.
StreamInfo

Functions§

reassemble
Fold SSE chunks into one non-streamed completion: content and reasoning concatenated, tool calls merged by index (id and name from the first delta, arguments appended). An error event (llama-server sends one when its parser rejects the output mid-stream) is kept as the response’s top-level error, as in a non-streamed error body.