StreamingCompletion

rig_extra::streaming

Trait StreamingCompletion 

Source 
pub trait StreamingCompletion<M>
where
    M: CompletionModel,
{
    // Required method
    fn stream_completion(
        &self,
        prompt: impl Into<Message> + WasmCompatSend,
        chat_history: Vec<Message>,
    ) -> impl Future<Output = Result<CompletionRequestBuilder<M>, CompletionError>>;
}
Expand description

Trait for low-level streaming completion interface

Required Methods§

Source

fn stream_completion( &self, prompt: impl Into<Message> + WasmCompatSend, chat_history: Vec<Message>, ) -> impl Future<Output = Result<CompletionRequestBuilder<M>, CompletionError>>

Generate a streaming completion from a request

Dyn Compatibility§

This trait is not dyn compatible.

In older versions of Rust, dyn compatibility was called "object safety", so this trait is not object safe.

Implementors§