Module core 

Shared HTTP mechanics for the built-in disaggregated-serving proxies.

Proxy-specific protocol bodies remain in their owning modules.

Structs

FanoutFailure

Failure detail of one reset/flush fan-out target.

PrimePrefixCacheResponse

Aggregated response of the prefix-cache conditioning fan-out endpoint. The control plane deserializes this exact shape, so the fields are the cross-process contract.

PrimePrefixCacheTarget

One fanned-out conditioning flow: the prefill replica URL and the pinned data-parallel rank, with the observed status or the failure detail.

ProxyErrorResponse

ProxyHealthcheckResponse

Healthcheck response body shared by the proxies.

ProxyHttpError

Per-request error of the HTTP handlers: an HTTP status plus a message.

ResetPrefixCacheResponse

Aggregated response of the cache reset/flush fan-out endpoints. SGLang’s flush_cache and the vLLM proxies’ reset_prefix_cache share this wire contract.

Functions

forward_response

Forward an upstream response body verbatim, preserving status and content-type.

join_path

Join a base URL with a path, normalizing a single trailing slash on the base.

outbound_authorization

Resolve the outbound Authorization header from the inbound request or the OPENAI_API_KEY environment variable.

run

Build a multi-threaded Tokio runtime and drive run_async to completion.

status_code

Convert a reqwest status code into an axum/http status code.

upstream_status_error

Convert an unsuccessful upstream response into a 502 Bad Gateway ProxyHttpError that captures the upstream status and body.