Expand description
Model failover and auth profile rotation.
Provides automatic failover when a model provider returns errors, and rotation through multiple auth profiles (API keys) for load distribution and rate-limit avoidance.
Structs§
- Auth
Profile - An auth profile — a named set of credentials for a provider.
- Failover
Config - Failover configuration for a provider.
- Failover
Manager - Model failover manager.
- Health
Stats - Health statistics snapshot.
- Health
Tracker - Tracks the health of a model/profile combination.
Enums§
- Failover
Strategy - Failover strategy.