Expand description
Multi-provider failover with circuit breaker and auth profile rotation.
Provides resilient LLM access by:
- Trying providers in priority order
- Skipping providers with open circuit breakers
- Rotating auth profiles on rate limit errors
- Automatic recovery via half-open circuit state
Structs§
- Auth
Profile - A single set of credentials for a provider.
- Circuit
Breaker - A circuit breaker that trips after consecutive failures and recovers after a timeout.
- Failover
Provider - An LLM provider that tries multiple backends in priority order, skipping providers with open circuit breakers.
Enums§
- Circuit
State - State of a circuit breaker.