llm_providers 0.2.2

Philosophy

Managing LLM provider configurations across multiple projects and languages is a pain. LLM Providers solves this by maintaining a single, curated JSON source of truth for:

• Model IDs & Names
• Context Windows & Max Output Tokens
• Pricing (Input/Output)
• Capabilities (Tool Support, Vision, etc.)

This data is embedded at compile-time into a Rust crate for zero-latency access and exposed to Python via high-performance bindings.

Features

• 🚀 Zero-Latency: Data is compiled into the binary; no runtime I/O or API calls.
• 🦀 Rust Native: Type-safe structs (Provider, Model) for robust development.
• 🐍 Python Ready: Seamless integration via pip install llm-providers-list.
• 🔄 Unified Schema: Consistent data structure across all providers (OpenAI, Anthropic, DeepSeek, etc.).
• 📦 Rich Metadata: Includes pricing, context length, and tool support flags.

Installation

Rust

Add this to your Cargo.toml:

[dependencies]
llm_providers = { git = "https://github.com/lipish/llm-providers.git" }

Python

Install via pip (once published) or build from source:

# From PyPI (Coming Soon)
pip install llm-providers-list

# Build from source (requires maturin)
pip install maturin
maturin develop -m py/Cargo.toml

Usage

Rust

use llm_providers::{get_providers_data, list_providers, list_models, get_model};

fn main() {
    // 1. Get raw map of all providers
    let providers = get_providers_data();
    if let Some(openai) = providers.get("openai") {
        println!("Provider: {}", openai.label);
    }

    // 2. List all provider IDs
    let provider_ids = list_providers();
    println!("Providers: {:?}", provider_ids);

    // 3. List models for a specific provider
    if let Some(models) = list_models("openai") {
        println!("OpenAI Models: {:?}", models);
    }

    // 4. Get specific model details
    if let Some(model) = get_model("openai", "gpt-4o") {
        println!("Model: {} (Price: ${}/1M input)", model.name, model.input_price);
    }
}

Python

import llm_providers_list

# 1. List all supported providers
print(llm_providers_list.list_providers())
# Output: ['aliyun', 'anthropic', 'deepseek', 'openai', ...]

# 2. List models for a specific provider
print(llm_providers_list.list_models("openai"))
# Output: ['gpt-4o', 'gpt-3.5-turbo', ...]

# 3. Get specific model details
model = llm_providers_list.get_model("openai", "gpt-4o")
print(f"Model: {model.name}, Price: ${model.input_price}/1M tokens")

# 4. Get full provider object (Rich Type)
openai = llm_providers_list.get_provider("openai")
print(f"Label: {openai.label}")
print(f"Base URL: {openai.base_url}")

Advanced Usage

Filtering Models

You can filter models by region, capabilities (tools), or context length.

Rust

use llm_providers::{filter_models, ModelFilter};

let cn_models = filter_models(ModelFilter {
    region: Some("cn".to_string()),
    supports_tools: Some(true),
    ..Default::default()
});

for (provider_id, model) in cn_models {
    println!("{}: {}", provider_id, model.name);
}

Python

import llm_providers_list

# Find all models in CN region that support tools
cn_tools_models = llm_providers_list.filter_models(
    region="cn", 
    supports_tools=True
)

for provider_id, model in cn_tools_models:
    print(f"[{provider_id}] {model.name} ({model.price_currency})")

Data Structure

The registry uses a structured schema enforced by providers.schema.json.

• Provider Family: Grouping for providers (e.g., openai, aliyun).
• Region: cn (China), global (International), us, eu, etc.
• Price Currency: USD or CNY.

Supported Providers

• OpenAI (GPT-4o, GPT-3.5, o1)
• Anthropic (Claude 3.5 Sonnet, Haiku, Opus)
• DeepSeek (Chat, Reasoner)
• Aliyun (Qwen Max, Plus, Turbo)
• Tencent (Hunyuan)
• Moonshot (Kimi)
  • Moonshot AI (CN)
  • Moonshot AI Global
• MiniMax
  • MiniMax (CN)
  • MiniMax Global
• Zhipu (GLM-4)
  • BigModel (Zhipu CN)
  • Z.ai (Zhipu Global)
• Volcengine (Doubao)
• LongCat

Contributing

Contributions are welcome! To add a new provider or update existing models:

1. Edit providers.json in the root directory.
2. Run tests to ensure validity:

   cargo test
   

3. Submit a Pull Request.

License

MIT