Skip to main content

ModelStream

Type Alias ModelStream 

Source
pub type ModelStream = Pin<Box<dyn Stream<Item = Result<StreamChunk, CompletionError>> + Send>>;
Expand description

The streaming response returned by a model invocation.

Aliased Typeยง

#[repr(transparent)]
pub struct ModelStream { /* private fields */ }