Trait StreamingChat 

pub trait StreamingChat<M, R>: WasmCompatSend + WasmCompatSync
where
    M: CompletionModel + 'static,
    M::StreamingResponse: WasmCompatSend,
    R: Clone + Unpin + GetTokenUsage,
{
    // Required method
    fn stream_chat<I, T>(
        &self,
        prompt: impl Into<Message> + WasmCompatSend,
        chat_history: I,
    ) -> StreamingPromptRequest<M>
       where I: IntoIterator<Item = T> + WasmCompatSend,
             T: Into<Message>;
}

High-level streaming chat interface with caller-provided history.

Required Methods

fn stream_chat<I, T>( &self, prompt: impl Into<Message> + WasmCompatSend, chat_history: I, ) -> StreamingPromptRequest<M>

where I: IntoIterator<Item = T> + WasmCompatSend, T: Into<Message>,

Create a classic streaming request with canonical chat history.

Dyn Compatibility

This trait is not dyn compatible.

In older versions of Rust, dyn compatibility was called "object safety".

Implementors

impl<M> StreamingChat<M, <M as CompletionModel>::StreamingResponse> for Agent<M>

where M: CompletionModel + 'static, M::StreamingResponse: GetTokenUsage,