Skip to main content

Module upstream

Module upstream 

Source
Expand description

Upstream pool management module for Sentinel proxy

This module handles upstream server pools, load balancing, health checking, connection pooling, and retry logic with circuit breakers.

Re-exports§

pub use adaptive::AdaptiveBalancer;
pub use adaptive::AdaptiveConfig;
pub use consistent_hash::ConsistentHashBalancer;
pub use consistent_hash::ConsistentHashConfig;
pub use health::ActiveHealthChecker;
pub use health::HealthCheckRunner;
pub use inference_health::InferenceHealthCheck;
pub use least_tokens::LeastTokensQueuedBalancer;
pub use least_tokens::LeastTokensQueuedConfig;
pub use least_tokens::LeastTokensQueuedTargetStats;
pub use locality::LocalityAwareBalancer;
pub use locality::LocalityAwareConfig;
pub use maglev::MaglevBalancer;
pub use maglev::MaglevConfig;
pub use p2c::P2cBalancer;
pub use p2c::P2cConfig;
pub use peak_ewma::PeakEwmaBalancer;
pub use peak_ewma::PeakEwmaConfig;
pub use sticky_session::StickySessionBalancer;
pub use sticky_session::StickySessionRuntimeConfig;
pub use subset::SubsetBalancer;
pub use subset::SubsetConfig;
pub use weighted_least_conn::WeightedLeastConnBalancer;
pub use weighted_least_conn::WeightedLeastConnConfig;

Modules§

adaptive
consistent_hash
health
Active health checking using Pingora’s HttpHealthCheck
inference_health
Inference-specific health check for LLM backends.
least_tokens
Least Tokens Queued load balancer for inference workloads
locality
Locality-aware load balancer
maglev
Maglev consistent hashing load balancer
p2c
peak_ewma
Peak EWMA load balancer
sticky_session
Cookie-based sticky session load balancer
subset
Deterministic Subsetting load balancer
weighted_least_conn
Weighted Least Connections load balancer

Structs§

ConnectionPoolConfig
Connection pool configuration for Pingora’s built-in pooling
HttpVersionOptions
HTTP version configuration for upstream connections
PoolConfigSnapshot
Snapshot of pool configuration for metrics/debugging
PoolStats
Pool statistics
RequestContext
Request context for load balancer decisions
ShadowTarget
Target information for shadow traffic
TargetSelection
Selected upstream target
UpstreamPool
Upstream pool managing multiple backend servers
UpstreamTarget
Internal upstream target representation for load balancers

Traits§

LoadBalancer
Load balancer trait for different algorithms