Skip to main content

StreamingPrompt

rig_agent::streaming

Trait StreamingPrompt

pub trait StreamingPrompt<M, R>where
    M: CompletionModel + 'static,
    M::StreamingResponse: WasmCompatSend,
    R: Clone + Unpin + GetTokenUsage,{
    // Required method
    fn stream_prompt(
        &self,
        prompt: impl Into<Message> + WasmCompatSend,
    ) -> StreamingPromptRequest<M>;
}

Expand description

High-level one-shot streaming prompt interface.

Required Methods§

fn stream_prompt( &self, prompt: impl Into<Message> + WasmCompatSend, ) -> StreamingPromptRequest<M>

Create a classic streaming request for prompt.

Dyn Compatibility§

This trait is not dyn compatible.

In older versions of Rust, dyn compatibility was called "object safety".

Implementors§

impl<M> StreamingPrompt<M, <M as CompletionModel>::StreamingResponse> for Agent<M>
where M: CompletionModel + 'static, M::StreamingResponse: GetTokenUsage,