Expand description
Upstream pool management module for Sentinel proxy
This module handles upstream server pools, load balancing, health checking, connection pooling, and retry logic with circuit breakers.
Re-exports§
pub use adaptive::AdaptiveBalancer;pub use adaptive::AdaptiveConfig;pub use consistent_hash::ConsistentHashBalancer;pub use consistent_hash::ConsistentHashConfig;pub use health::ActiveHealthChecker;pub use health::HealthCheckRunner;pub use inference_health::InferenceHealthCheck;pub use least_tokens::LeastTokensQueuedBalancer;pub use least_tokens::LeastTokensQueuedConfig;pub use least_tokens::LeastTokensQueuedTargetStats;pub use locality::LocalityAwareBalancer;pub use locality::LocalityAwareConfig;pub use maglev::MaglevBalancer;pub use maglev::MaglevConfig;pub use p2c::P2cBalancer;pub use p2c::P2cConfig;pub use peak_ewma::PeakEwmaBalancer;pub use peak_ewma::PeakEwmaConfig;pub use sticky_session::StickySessionBalancer;pub use sticky_session::StickySessionRuntimeConfig;pub use subset::SubsetBalancer;pub use subset::SubsetConfig;pub use weighted_least_conn::WeightedLeastConnBalancer;pub use weighted_least_conn::WeightedLeastConnConfig;
Modules§
- adaptive
- consistent_
hash - health
- Active health checking using Pingora’s HttpHealthCheck
- inference_
health - Inference-specific health check for LLM backends.
- least_
tokens - Least Tokens Queued load balancer for inference workloads
- locality
- Locality-aware load balancer
- maglev
- Maglev consistent hashing load balancer
- p2c
- peak_
ewma - Peak EWMA load balancer
- sticky_
session - Cookie-based sticky session load balancer
- subset
- Deterministic Subsetting load balancer
- weighted_
least_ conn - Weighted Least Connections load balancer
Structs§
- Connection
Pool Config - Connection pool configuration for Pingora’s built-in pooling
- Http
Version Options - HTTP version configuration for upstream connections
- Pool
Config Snapshot - Snapshot of pool configuration for metrics/debugging
- Pool
Stats - Pool statistics
- Request
Context - Request context for load balancer decisions
- Shadow
Target - Target information for shadow traffic
- Target
Selection - Selected upstream target
- Upstream
Pool - Upstream pool managing multiple backend servers
- Upstream
Target - Internal upstream target representation for load balancers
Traits§
- Load
Balancer - Load balancer trait for different algorithms