Crate inferlab_proxy 

Re-exports

pub use error::ProxyError;

Modules

core

Shared HTTP mechanics for the built-in disaggregated-serving proxies.

error

sglang

Built-in routing for SGLang prefill/decode serving under [[RFC-0003:C-SGLANG-PREFILL-DECODE]].

trtllm

Built-in routing for TensorRT-LLM prefill/decode serving under [[RFC-0003:C-TENSORRT-LLM-PREFILL-DECODE]].

vllm_mooncake

vllm_nixl