pub type LlmResponseStream = Pin<Box<dyn Stream<Item = Result<LlmResponse>> + Send>>;Expand description
A stream of LlmResponse events from an LLM provider.
This is a pinned, boxed, Send stream used as the return type of
StreamingModelProvider::stream_response. Boxing is required to support
trait objects (Vec<Box<dyn StreamingModelProvider>>) in types like
AlloyedModelProvider.
Aliased Typeยง
pub struct LlmResponseStream { /* private fields */ }