Struct ChatStream 

pub struct ChatStream { /* private fields */ }

Streaming response wrapper.

Wraps an async Stream and provides convenient collection methods.

Implementations

impl ChatStream

pub fn new( stream: Pin<Box<dyn Stream<Item = Result<StreamChunk, LlmError>> + Send>>, ) -> ChatStream

Create a new ChatStream.

pub fn into_inner( self, ) -> Pin<Box<dyn Stream<Item = Result<StreamChunk, LlmError>> + Send>>

Consume self and return the inner stream.

Useful for adapters that need to wrap the stream in a different type.

pub async fn next(&mut self) -> Option<Result<StreamChunk, LlmError>>

Get the next chunk.

pub async fn collect_text(self) -> Result<String, LlmError>

Collect all text into a string.

Note: this loses tool calls and usage information. Use collect_response for the full response.

pub async fn collect_response(self) -> Result<ChatResponse, LlmError>

Collect full response (including tool calls, usage).

Used by GenericProvider::chat() stream fallback mode, ensuring no tool calls or usage info is lost.

Handles incremental tool call assembly: tool calls arrive across multiple chunks (first has id+name, subsequent have only argument fragments).