Expand description
速率限制和背压控制模块,防止AI API调用过载
Rate limiting and backpressure control module for AI API calls.
This module implements token bucket algorithms and backpressure mechanisms to prevent overwhelming AI providers with too many concurrent requests.
Key components:
TokenBucket: Token bucket rate limiter implementationBackpressureController: Manages concurrent request limitsRateLimiterConfig: Configuration for rate limiting parameters
Re-exports§
pub use backpressure::BackpressureController;pub use backpressure::BackpressurePermit;pub use config::RateLimiterConfig;pub use token_bucket::TokenBucket;
Modules§
- backpressure
- Backpressure control for managing concurrent requests
- config
- Rate limiter configuration
- token_
bucket - Token bucket rate limiter implementation