pub trait CompletionModel {
type Error: Error + 'static;
// Required method
fn complete(
&self,
request: CompletionRequest,
) -> impl Future<Output = Result<CompletionResponse, Self::Error>>;
}Expand description
The core abstraction for any text-generation model.
Implement this for each provider (OpenAI, Anthropic, …) or for your own local model backend.
Required Associated Types§
Required Methods§
Sourcefn complete(
&self,
request: CompletionRequest,
) -> impl Future<Output = Result<CompletionResponse, Self::Error>>
fn complete( &self, request: CompletionRequest, ) -> impl Future<Output = Result<CompletionResponse, Self::Error>>
Send a completion request and return the model’s response.
Dyn Compatibility§
This trait is not dyn compatible.
In older versions of Rust, dyn compatibility was called "object safety".