Module proxy 

Sentinel Proxy Core Implementation

This module contains the main SentinelProxy struct and its implementation, split across several submodules for maintainability:

• context: Request context maintained throughout the request lifecycle
• handlers: Helper methods for handling different route types
• http_trait: ProxyHttp trait implementation for Pingora

Structs

FallbackDecision

Decision to fall back to an alternative upstream.

FallbackEvaluator

Evaluates fallback conditions and selects alternative upstreams.

FallbackMetrics

Fallback routing metrics collector.

ModelRoutingMetrics

Model routing metrics collector.

ModelRoutingResult

Result of model-based routing lookup.

RequestContext

Request context maintained throughout the request lifecycle.

SentinelProxy

Main proxy service implementing Pingora’s ProxyHttp trait

Enums

FallbackReason

Reason why fallback routing was triggered

Functions

extract_model_from_headers

Extract model name from request headers.

find_upstream_for_model

Find the upstream for a given model name.

get_fallback_metrics

Get or initialize the global fallback metrics.

get_model_routing_metrics

Get or initialize the global model routing metrics.

init_fallback_metrics

Initialize the global fallback metrics. Returns Ok if already initialized or initialization succeeds.

init_model_routing_metrics

Initialize the global model routing metrics. Returns Ok if already initialized or initialization succeeds.