Trait StreamingCompletion 

pub trait StreamingCompletion<M: CompletionModel> {
    // Required method
    fn stream_completion<I, T>(
        &self,
        prompt: impl Into<Message> + WasmCompatSend,
        chat_history: I,
    ) -> impl Future<Output = Result<CompletionRequestBuilder<M>, CompletionError>>
       where I: IntoIterator<Item = T> + WasmCompatSend,
             T: Into<Message>;
}

Trait for low-level streaming completion interface

Required Methods

fn stream_completion<I, T>( &self, prompt: impl Into<Message> + WasmCompatSend, chat_history: I, ) -> impl Future<Output = Result<CompletionRequestBuilder<M>, CompletionError>>

where I: IntoIterator<Item = T> + WasmCompatSend, T: Into<Message>,

Generate a streaming completion from a request

Dyn Compatibility

This trait is not dyn compatible.

In older versions of Rust, dyn compatibility was called "object safety", so this trait is not object safe.

Implementors

impl<M, P> StreamingCompletion<M> for Agent<M, P>

where M: CompletionModel, P: PromptHook<M>,