Expand description
Per-agent routing weights and rate-limit recovery.
RateLimitState tracks a single agent’s current routing weight and
recovers it over time after rate-limit events.
AgentWeights aggregates per-agent states and provides weighted
probabilistic selection via weighted_select.
Structs§
- Agent
Weights - Tracks per-agent weights for weighted round-robin routing.
- Rate
Limit State - Rate limit state for a single agent.