pub type TokenStream = Pin<Box<dyn Stream<Item = TokenEvent> + Send>>;Expand description
Stream of TokenEvent values produced by a backend during generation.
Dropping the stream cancels the in-flight generation. Adapters must wire
drop to their underlying cancellation primitive (e.g. a CancellationToken
or by aborting the spawned task).
Aliased Typeยง
pub struct TokenStream { /* private fields */ }