Skip to main content

Module provider

Module provider 

Source
Expand description

LLM provider catalog and capability profiles.

The embedded catalog (catalog.json) contains 20 providers with model metadata aligned to the models.dev schema: pricing, token limits, modalities, and capability flags.

use llm_kernel::provider::ProviderIndex;

let catalog = ProviderIndex::embedded();
assert!(!catalog.ids().is_empty());

Re-exports§

pub use capability::AuthStrategy;
pub use capability::CapabilityProfile;
pub use catalog::ModelCapabilities;
pub use catalog::ModelCost;
pub use catalog::ModelDescriptor;
pub use catalog::ModelLimit;
pub use catalog::ModelModalities;
pub use catalog::ProviderIndex;
pub use catalog::ServiceDescriptor;
pub use mapping::Mapping;
pub use mapping::resolve;
pub use policy::DataPolicy;
pub use policy::ImagePolicy;
pub use policy::PolicyAction;
pub use policy::PolicyThreshold;
pub use policy::Sensitivity;

Modules§

capability
Capability profiles and authentication strategies for providers.
catalog
Provider catalog, model descriptors, and pricing data.
mapping
Provider-id mapping between the catalog and the models.dev upstream. Provider-id mapping between the embedded catalog and the models.dev upstream catalog.
policy
Provider data policy (DLP vocabulary carried on ServiceDescriptor). Provider data policy — what content may leave the machine for a provider.
sync
Catalog sync tooling — merge models.dev into the embedded catalog. Catalog sync engine — merge a live models.dev payload into the embedded catalog.