rig::streaming

Trait StreamingCompletionModel

Source 
pub trait StreamingCompletionModel: CompletionModel {
    // Required method
    fn stream(
        &self,
        request: CompletionRequest,
    ) -> impl Future<Output = Result<StreamingResult, CompletionError>>;
}
Expand description

Trait defining a streaming completion model

Required Methods§

Source

fn stream( &self, request: CompletionRequest, ) -> impl Future<Output = Result<StreamingResult, CompletionError>>

Stream a completion response for the given request

Dyn Compatibility§

This trait is not dyn compatible.

In older versions of Rust, dyn compatibility was called "object safety", so this trait is not object safe.

Implementors§