Skip to main content

TokenStream

Type Alias TokenStream 

Source
pub type TokenStream = Pin<Box<dyn Stream<Item = TokenEvent> + Send>>;
Expand description

Stream of TokenEvent values produced by a backend during generation.

Dropping the stream cancels the in-flight generation. Adapters must wire drop to their underlying cancellation primitive (e.g. a CancellationToken or by aborting the spawned task).

Aliased Typeยง

pub struct TokenStream { /* private fields */ }