Module streaming

Module streaming 

Source
Expand description

Streaming types for LLM responses.

This module provides types for handling streaming responses from LLM providers. The StreamDelta enum represents individual events in a streaming response, and StreamAccumulator helps collect these events into a final response.

Structs§

StreamAccumulator
Helper to accumulate streamed content into a final response.
ToolUseAccumulator
Accumulator for a single tool use during streaming.

Enums§

StreamDelta
Events yielded during streaming LLM responses.

Type Aliases§

StreamBox
Type alias for a boxed stream of stream deltas.