Struct ProviderManager 

pub struct ProviderManager { /* private fields */ }

Manages a set of named providers with an active selection.

All methods that read or mutate the inner state acquire the RwLock. active() returns a clone of the current Provider — callers do not hold the lock while performing LLM calls.

Implementations

impl ProviderManager

pub fn new(active: impl Into<CompactString>) -> Self

Create an empty manager with the given active model name.

Use add_provider() or add_model() to populate.

pub async fn from_providers( active: CompactString, providers: &BTreeMap<CompactString, ProviderDef>, ) -> Result<Self>

Build a manager from a map of provider definitions and an active model.

Iterates each provider def, building a Provider instance per model in its models list.

pub fn add_provider( &self, name: impl Into<CompactString>, provider: Provider, ) -> Result<()>

Add a pre-built provider directly (e.g. local models from registry).

pub async fn add_def(&self, def: &ProviderDef) -> Result<()>

Add all models from a provider definition. Builds a Provider per model.

pub fn active(&self) -> Result<Provider>

Get a clone of the active provider.

pub fn active_model_name(&self) -> Result<CompactString>

Get the model name of the active provider (also its key).

pub fn switch(&self, model: &str) -> Result<()>

Switch to a different provider by model name. Returns an error if the name is not found.

pub fn remove(&self, model: &str) -> Result<()>

Remove a provider by model name. Fails if the provider is currently active.

pub fn list(&self) -> Result<Vec<ProviderEntry>>

List all providers with their active status.

pub fn context_limit(&self, model: &str) -> usize

Resolve the context limit for a model.

Uses the static map in wcore::model::default_context_limit.

Trait Implementations

impl Clone for ProviderManager

fn clone(&self) -> Self

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Debug for ProviderManager

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl Model for ProviderManager

async fn send(&self, request: &Request) -> Result<Response>

Send a chat completion request.

fn stream( &self, request: Request, ) -> impl Stream<Item = Result<StreamChunk>> + Send

Stream a chat completion response.

fn context_limit(&self, model: &str) -> usize

Resolve the context limit for a model name.

fn active_model(&self) -> CompactString

Get the active/default model name.