Skip to main content

CompletionModel

Trait CompletionModel 

Source
pub trait CompletionModel: LanguageModel {
    // Provided methods
    fn completion<P>(
        &self,
        prompt: P,
        options: GenerationOptions,
    ) -> impl Future<Output = Result<ResponseText, Error>> + '_
       where P: TryInto<Prompt>,
             P::Error: Into<Error> { ... }
    fn stream_completion<P>(
        &self,
        prompt: P,
        options: GenerationOptions,
    ) -> Result<ResponseStream, Error>
       where P: TryInto<Prompt>,
             P::Error: Into<Error> { ... }
}
Expand description

Compatibility trait for older completion-oriented naming.

Provided Methods§

Source

fn completion<P>( &self, prompt: P, options: GenerationOptions, ) -> impl Future<Output = Result<ResponseText, Error>> + '_
where P: TryInto<Prompt>, P::Error: Into<Error>,

Generates response text for a prompt with explicit generation options.

§Errors

Returns Error when prompt conversion, option validation, session creation, or model generation fails.

Source

fn stream_completion<P>( &self, prompt: P, options: GenerationOptions, ) -> Result<ResponseStream, Error>
where P: TryInto<Prompt>, P::Error: Into<Error>,

Streams response text for a prompt with explicit generation options.

§Errors

Returns Error when prompt conversion, option validation, session creation, or stream startup fails.

Dyn Compatibility§

This trait is not dyn compatible.

In older versions of Rust, dyn compatibility was called "object safety", so this trait is not object safe.

Implementors§

Source§

impl<T> CompletionModel for T
where T: LanguageModel,