Expand description
Token bucket rate limiter for cloud API calls.
Prevents hitting provider rate limits (IBM: 5 jobs/min, AWS: 10 req/s, etc.) by tracking token consumption per backend. The token bucket algorithm smooths bursty traffic while respecting sustained-rate limits.
Structsยง
- Rate
Limiter - Per-provider token-bucket rate limiter.
- Token
Bucket - A token bucket: accumulates capacity tokens at
refill_ratetokens/second.