Module streaming

Source
Expand description

§RSLLM Streaming Support

Streaming response handling with proper async Stream traits. Supports real-time token streaming with backpressure and error handling.

Structs§

FilteredStream
MappedStream
RateLimitedStream
StreamCollector
StreamUtils
Stream utilities

Traits§

RsllmStreamExt
Stream extension traits for additional functionality

Type Aliases§

ChatStream
Type alias for chat streaming responses
CompletionStream
Type alias for completion streaming responses