Skip to main content

InferenceProvider

falsegreen_agent::inference

Trait InferenceProvider 

Source 
pub trait InferenceProvider {
    // Required methods
    fn capabilities(&self) -> ProviderCapabilities;
    fn complete(
        &mut self,
        request: &InferenceRequest,
    ) -> Result<ModelResponse, InferenceError>;
}

Required Methods§

Source

fn capabilities(&self) -> ProviderCapabilities

Source

fn complete( &mut self, request: &InferenceRequest, ) -> Result<ModelResponse, InferenceError>

Dyn Compatibility§

This trait is dyn compatible.

In older versions of Rust, dyn compatibility was called "object safety".

Implementors§