Expand description
Rate limiting and backpressure control for AI API calls
This module provides rate limiting functionality to prevent overwhelming AI providers and implement backpressure mechanisms.
Re-exports§
pub use backpressure::BackpressureController;pub use backpressure::BackpressurePermit;pub use config::RateLimiterConfig;pub use token_bucket::TokenBucket;
Modules§
- backpressure
- Backpressure control for managing concurrent requests
- config
- Rate limiter configuration
- token_
bucket - Token bucket rate limiter implementation