Struct ModelProviderParser 

pub struct ModelProviderParser { /* private fields */ }

Parses "provider:model" strings into live StreamingModelProvider instances.

This is the primary entry point for creating providers from user-supplied model specifications at runtime. It handles provider lookup, credential loading, and model configuration in one step.

Format

• Single provider – "anthropic:claude-sonnet-4-5-20250929" or "ollama:llama3.2"
• Multiple providers – "anthropic:claude-sonnet-4-5-20250929,openai:gpt-4o" creates an AlloyedModelProvider that cycles between them.

Built-in providers

Default::default() registers all built-in providers: anthropic, openai, openrouter, gemini, ollama, llamacpp, deepseek, moonshot, xiaomi, zai, and (with feature flags) bedrock and codex.

Custom providers

Register additional providers with with_generic_provider (for endpoints described by a ProviderConfig).

Example

use llm::parser::ModelProviderParser;
use llm::{ProviderConnectionOverrides, StreamingModelProvider};

let parser = ModelProviderParser::default();
let (provider, model) = parser.parse("ollama:llama3.2", &ProviderConnectionOverrides::default()).await.unwrap();
println!("Provider: {}", provider.display_name());
println!("Model: {model}");

Implementations

impl ModelProviderParser

pub fn with_codex_provider(self, codex: CodexProvider) -> Self

pub fn with_generic_provider(self, config: &'static ProviderConfig) -> Self

pub async fn parse( &self, models_str: &str, connections: &ProviderConnectionOverrides, ) -> Result<(Box<dyn StreamingModelProvider>, LlmModel)>

Parse a model specification string and create a provider instance.

Returns both the provider and an LlmModel describing the identity of the first (or only) provider in the spec.

Format

• "provider:model" - Single provider (e.g., “anthropic:claude-3.5-sonnet”)
• "provider1:model1,provider2:model2" - Multiple providers create an AlloyedModelProvider

Trait Implementations

impl Default for ModelProviderParser

fn default() -> Self

Create a parser with all built-in providers registered