Skip to main content

Module streaming

Module streaming 

Source
Expand description

Streaming types for LLM responses.

This module provides types for handling streaming responses from LLM providers. The StreamDelta enum represents individual events in a streaming response, and StreamAccumulator helps collect these events into a final response.

Structs§

StreamAccumulator
Helper to accumulate streamed content into a final response.
ToolUseAccumulator
Accumulator for a single tool use during streaming.

Enums§

StreamDelta
Events yielded during streaming LLM responses.

Type Aliases§

StreamBox
Type alias for a boxed stream of stream deltas.