Struct ProviderManager 

pub struct ProviderManager { /* private fields */ }

Manages a set of named providers with an active selection.

All methods that read or mutate the inner state acquire the RwLock. active() returns a clone of the current Provider — callers do not hold the lock while performing LLM calls.

Implementations

impl ProviderManager

pub fn new(active: impl Into<CompactString>) -> ProviderManager

Create an empty manager with the given active model name.

Use add_provider() or add_config() to populate.

pub async fn from_configs( configs: &[ProviderConfig], ) -> Result<ProviderManager, Error>

Create a manager from a list of remote provider configs.

The first element becomes the active provider. Returns an error if the slice is empty, any config fails validation, or any provider fails to build.

pub fn add_provider( &self, name: impl Into<CompactString>, provider: Provider, ) -> Result<(), Error>

Add a pre-built provider directly (e.g. local models from registry).

pub async fn add_config(&self, config: &ProviderConfig) -> Result<(), Error>

Add a remote provider from config. Validates and builds it.

pub fn active(&self) -> Result<Provider, Error>

Get a clone of the active provider.

pub fn active_model_name(&self) -> Result<CompactString, Error>

Get the model name of the active provider (also its key).

pub fn switch(&self, model: &str) -> Result<(), Error>

Switch to a different provider by model name. Returns an error if the name is not found.

pub fn remove(&self, model: &str) -> Result<(), Error>

Remove a provider by model name. Fails if the provider is currently active.

pub fn list(&self) -> Result<Vec<ProviderEntry>, Error>

List all providers with their active status.

pub async fn wait_until_ready(&self) -> Result<(), Error>

Wait until the active provider is ready.

No-op for remote providers. For local providers, blocks until the model finishes loading.

pub fn context_limit(&self, model: &str) -> usize

Resolve the context limit for a model.

Resolution chain: provider reports limit → static map → 8192 default. Falls back to the static default if the lock is poisoned.

Trait Implementations

impl Clone for ProviderManager

fn clone(&self) -> ProviderManager

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Debug for ProviderManager

fn fmt(&self, f: &mut Formatter<'_>) -> Result<(), Error>

Formats the value using the given formatter.

impl Model for ProviderManager

async fn send(&self, request: &Request) -> Result<Response, Error>

Send a chat completion request.

fn stream( &self, request: Request, ) -> impl Stream<Item = Result<StreamChunk, Error>> + Send

Stream a chat completion response.

fn context_limit(&self, model: &str) -> usize

Resolve the context limit for a model name.

fn active_model(&self) -> CompactString

Get the active/default model name.