Struct ResponseStream 

pub struct ResponseStream { /* private fields */ }

An async stream of text chunks produced by LanguageModelSession::stream.

Each item is Ok(ResponseText) for a new chunk, or Err(Error) if generation failed. The stream ends when the model finishes generating.

Implements futures_core::Stream; use with .next() from StreamExt or any executor that can drive Stream.

Trait Implementations

impl Stream for ResponseStream

type Item = Result<ResponseText, Error>

Values yielded by the stream.

fn poll_next( self: Pin<&mut Self>, cx: &mut StdContext<'_>, ) -> Poll<Option<Self::Item>>

Attempt to pull out the next value of this stream, registering the current task for wakeup if the value is not yet available, and returning None if the stream is exhausted.

fn size_hint(&self) -> (usize, Option<usize>)

Returns the bounds on the remaining length of the stream.