Trait StreamingPrompt

pub trait StreamingPrompt: Send + Sync {
    // Required method
    fn stream_prompt(
        &self,
        prompt: &str,
    ) -> impl Future<Output = Result<StreamingResult, CompletionError>>;
}

Trait for high-level streaming prompt interface

Required Methods

fn stream_prompt( &self, prompt: &str, ) -> impl Future<Output = Result<StreamingResult, CompletionError>>

Stream a simple prompt to the model

Dyn Compatibility

This trait is not dyn compatible.

In older versions of Rust, dyn compatibility was called "object safety", so this trait is not object safe.

Implementors

impl<M: StreamingCompletionModel> StreamingPrompt for Agent<M>