List of all items

Structs

• core::FanoutFailure
• core::PrimePrefixCacheResponse
• core::PrimePrefixCacheTarget
• core::ProxyErrorResponse
• core::ProxyHealthcheckResponse
• core::ProxyHttpError
• core::ResetPrefixCacheResponse
• registry::BuiltinProxySpec
• sglang::Config
• sglang::PrefillTarget
• trtllm::Config
• vllm_mooncake::Config
• vllm_mooncake::PrefillTarget
• vllm_nixl::Config
• vllm_nixl::PrefillTarget

Enums

• error::ProxyError
• registry::BuiltinProxyKind

Functions

• core::forward_response
• core::join_path
• core::outbound_authorization
• core::run
• core::status_code
• core::upstream_status_error
• registry::builtin_proxy_by_wire_name
• sglang::run
• sglang::run_async
• trtllm::run
• trtllm::run_async
• vllm_mooncake::run
• vllm_mooncake::run_async
• vllm_nixl::run
• vllm_nixl::run_async

Constants

• registry::BUILTIN_PROXIES
• registry::SGLANG
• registry::TRTLLM
• registry::VLLM_MOONCAKE
• registry::VLLM_NIXL
• sglang::CHAT_COMPLETIONS_PATH
• sglang::COMPLETIONS_PATH
• sglang::HEALTHCHECK_PATH
• sglang::PRIME_PREFIX_CACHE_PATH
• sglang::RESET_PREFIX_CACHE_PATH
• sglang::VERSION
• trtllm::CHAT_COMPLETIONS_PATH
• trtllm::COMPLETIONS_PATH
• trtllm::HEALTHCHECK_PATH
• trtllm::VERSION
• vllm_mooncake::CHAT_COMPLETIONS_PATH
• vllm_mooncake::COMPLETIONS_PATH
• vllm_mooncake::HEALTHCHECK_PATH
• vllm_mooncake::PRIME_PREFIX_CACHE_PATH
• vllm_mooncake::RESET_PREFIX_CACHE_PATH
• vllm_mooncake::VERSION
• vllm_nixl::CHAT_COMPLETIONS_PATH
• vllm_nixl::COMPLETIONS_PATH
• vllm_nixl::HEALTHCHECK_PATH
• vllm_nixl::PRIME_PREFIX_CACHE_PATH
• vllm_nixl::RESET_PREFIX_CACHE_PATH
• vllm_nixl::VERSION