Skip to main content

Module chat

gproxy_protocol::transform::generate::stream

Module chat 

Source
Expand description

Bounded native Chat collection and response synthesis. [DONE] is framing.

Structs§

ChatStreamCollector
Native Chat collector. The SSE decoder must call push_done for [DONE]; EOF after a finish chunk without the framing terminator remains incomplete.
ChatStreamContext
ChatStreamLimits

Functions§

synthesize_chat_stream
Synthesizes native JSON chunks. The framing encoder emits [DONE] after these chunks; the source’s actual creation time is retained.