Skip to main content

CompletionModel

Trait CompletionModel 

Source
pub trait CompletionModel {
    type Error: Error + 'static;

    // Required method
    fn complete(
        &self,
        request: CompletionRequest,
    ) -> impl Future<Output = Result<CompletionResponse, Self::Error>>;
}
Expand description

The core abstraction for any text-generation model.

Implement this for each provider (OpenAI, Anthropic, …) or for your own local model backend.

Required Associated Types§

Source

type Error: Error + 'static

Required Methods§

Source

fn complete( &self, request: CompletionRequest, ) -> impl Future<Output = Result<CompletionResponse, Self::Error>>

Send a completion request and return the model’s response.

Dyn Compatibility§

This trait is not dyn compatible.

In older versions of Rust, dyn compatibility was called "object safety".

Implementors§