Module provider

Source
Expand description

LLM provider abstractions and implementations

This module defines the core traits and types for integrating with various Language Model providers like Anthropic, OpenAI, Google, and others.

Structs§

Cost
Cost structure for model pricing
CurrentUsage
Current usage against rate limits
Limits
Model limits structure
ModelCapabilities
Model capabilities
ModelConfig
Model configuration
ModelInfo
Information about an available model
ModelLimits
Model limits and constraints
ModelMetadata
Model metadata
ModelPricing
Model pricing information
ModelUsage
Usage statistics for a specific model
PeriodUsage
Usage statistics for a time period
ProviderConfig
Provider configuration
ProviderHealth
Provider health status
ProviderRegistry
Registry for managing LLM providers
RateLimitInfo
Rate limiting information
RetryConfig
Retry configuration
UsageStats
Usage statistics for a provider

Enums§

ModelStatus
Model status
ProviderSource
Provider source enum
ProviderStatus
Provider status enum

Traits§

Model
Model trait for individual language models
Provider
Provider trait for LLM providers

Functions§

retry_with_backoff
Retry helper function with exponential backoff