Skip to main content

Module streaming

Module streaming 

Source
Expand description

Streaming provider support for OpenAI-compatible and Anthropic APIs.

This module adds SSE (Server-Sent Events) streaming to provider calls, allowing real-time token delivery to the TUI.

Structs§

StreamMessage
StreamRequest
Request parameters for streaming calls

Enums§

StreamChunk
A streaming chunk from the model

Functions§

call_anthropic_streaming
Call Anthropic endpoint with streaming.
call_openai_streaming
Call OpenAI-compatible endpoint with streaming. Sends chunks to the provided channel.