Expand description
Streaming provider support for OpenAI-compatible and Anthropic APIs.
This module adds SSE (Server-Sent Events) streaming to provider calls, allowing real-time token delivery to the TUI.
Structs§
- Stream
Message - Stream
Request - Request parameters for streaming calls
Enums§
- Stream
Chunk - A streaming chunk from the model
Functions§
- call_
anthropic_ streaming - Call Anthropic endpoint with streaming.
- call_
openai_ streaming - Call OpenAI-compatible endpoint with streaming. Sends chunks to the provided channel.