Skip to main content

StreamingResponse

Type Alias StreamingResponse 

Source
pub type StreamingResponse = Receiver<Result<TokenChunk, InferenceError>>;
Expand description

Streaming response handed back to the gateway for forwarding into the HTTP body. The gateway pulls next() until it sees None.

Aliased Type§

pub struct StreamingResponse { /* private fields */ }