Struct ProviderManager 

pub struct ProviderManager { /* private fields */ }

Manages a set of named providers with an active selection.

All methods that read or mutate the inner state acquire the RwLock. active() returns a clone of the current Provider — callers do not hold the lock while performing LLM calls.

Implementations

impl ProviderManager

pub async fn from_configs( configs: &[ProviderConfig], ) -> Result<ProviderManager, Error>

Create a new manager from a list of provider configs.

The first element becomes the active provider. Returns an error if the slice is empty, any config fails validation, or any provider fails to build.

pub fn single(config: ProviderConfig, provider: Provider) -> ProviderManager

Create a manager with a single provider.

pub fn active(&self) -> Provider

Get a clone of the active provider.

pub fn active_model(&self) -> CompactString

Get the model name of the active provider (also its key).

pub fn active_config(&self) -> ProviderConfig

Get a clone of the active provider’s config.

pub fn switch(&self, model: &str) -> Result<(), Error>

Switch to a different provider by model name. Returns an error if the name is not found.

pub async fn add(&self, config: &ProviderConfig) -> Result<(), Error>

Add a new provider. Validates config first. Replaces any existing provider with the same model name.

pub fn remove(&self, model: &str) -> Result<(), Error>

Remove a provider by model name. Fails if the provider is currently active.

pub fn list(&self) -> Vec<ProviderEntry>

List all providers with their active status.

pub fn context_limit(&self, model: &str) -> usize

Resolve the context limit for a model.

Resolution chain: provider reports limit → static map → 8192 default.

Trait Implementations

impl Clone for ProviderManager

fn clone(&self) -> ProviderManager

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Debug for ProviderManager

fn fmt(&self, f: &mut Formatter<'_>) -> Result<(), Error>

Formats the value using the given formatter.

impl Model for ProviderManager

async fn send(&self, request: &Request) -> Result<Response, Error>

Send a chat completion request.

fn stream( &self, request: Request, ) -> impl Stream<Item = Result<StreamChunk, Error>> + Send

Stream a chat completion response.

fn context_limit(&self, model: &str) -> usize

Resolve the context limit for a model name.

fn active_model(&self) -> CompactString

Get the active/default model name.