Skip to main content

InferenceStream

Type Alias InferenceStream 

Source
pub type InferenceStream = BoxStream<RuntimeResult<InferenceStreamEvent>>;
Expand description

Bounded asynchronous stream of normalized runtime-owned inference events.

Aliased Typeยง

#[repr(transparent)]
pub struct InferenceStream { /* private fields */ }