Skip to main content

Module streaming

cortiq_server

Module streaming 

Source
Expand description

SSE (Server-Sent Events) streaming for OpenAI-compatible chat completions.

Structs§

ChatStream
A streaming chat completion response.
StreamChoice
StreamChunk
A single chunk in the SSE stream.
StreamDelta

Functions§

finish_chunk
The terminal chunk carrying the real finish_reason.
token_chunk
A content-delta chunk (built synchronously from the generation thread).