autoagents_llm::models

Trait ModelsProvider

Source 
pub trait ModelsProvider {
    // Provided method
    fn list_models<'life0, 'life1, 'async_trait>(
        &'life0 self,
        _request: Option<&'life1 ModelListRequest>,
    ) -> Pin<Box<dyn Future<Output = Result<Box<dyn ModelListResponse>, LLMError>> + Send + 'async_trait>>
       where Self: Sync + 'async_trait,
             'life0: 'async_trait,
             'life1: 'async_trait { ... }
}
Expand description

Trait for providers that support listing and retrieving model information.

Provided Methods§

Source

fn list_models<'life0, 'life1, 'async_trait>( &'life0 self, _request: Option<&'life1 ModelListRequest>, ) -> Pin<Box<dyn Future<Output = Result<Box<dyn ModelListResponse>, LLMError>> + Send + 'async_trait>>
where Self: Sync + 'async_trait, 'life0: 'async_trait, 'life1: 'async_trait,

Asynchronously retrieves the list of available models ID’s from the provider.

§Arguments
  • _request - Optional filter by model ID
§Returns

List of model ID’s or error

Implementors§