Trait StreamingCompletion 

pub trait StreamingCompletion<M: CompletionModel> {
    // Required method
    fn stream_completion(
        &self,
        prompt: impl Into<Message> + WasmCompatSend,
        chat_history: Vec<Message>,
    ) -> impl Future<Output = Result<CompletionRequestBuilder<M>, CompletionError>>;
}

Trait for low-level streaming completion interface

Required Methods

fn stream_completion( &self, prompt: impl Into<Message> + WasmCompatSend, chat_history: Vec<Message>, ) -> impl Future<Output = Result<CompletionRequestBuilder<M>, CompletionError>>

Generate a streaming completion from a request

Dyn Compatibility

This trait is not dyn compatible.

In older versions of Rust, dyn compatibility was called "object safety", so this trait is not object safe.

Implementors

impl<M> StreamingCompletion<M> for Agent<M>

where M: CompletionModel,