Crate inferlab_proxy 

Re-exports

pub use error::ProxyError;

Modules

core

Shared HTTP mechanics for the built-in disaggregated-serving proxies.

error

registry

The registry of built-in proxy implementations ([[RFC-0006:C-INTEGRATIONS]]): one entry per control-plane-rendered frontend, binding the plan-declaration wire name, the internal CLI subcommand spelling, the proxy-kind behavior identity, and the proxy-owned version and route facts to a single table so consumers never restate them.

sglang

Built-in routing for SGLang prefill/decode serving under [[RFC-0003:C-SGLANG-PREFILL-DECODE]].

trtllm

Built-in routing for TensorRT-LLM prefill/decode serving under [[RFC-0003:C-TENSORRT-LLM-PREFILL-DECODE]].

vllm_mooncake

vllm_nixl