Expand description
HTTP server, route wiring, shared headers, and route errors.
Routes include Venice-backed model listing, encrypted chat request construction, response transformation, and OpenAI-compatible errors/headers.
Structs§
- AppState
- Shared HTTP application state used by route handlers.
- Proxy
Metadata Headers - Safe proxy metadata headers.
Enums§
- Chat
Stream Error - Errors returned while parsing, decrypting, or transforming upstream chat streams.
- Proxy
Error - Errors returned by HTTP handlers and rendered as OpenAI-compatible JSON errors.
Constants§
- HEADER_
PROXY_ ATTESTATION_ MODE - HEADER_
PROXY_ ATTESTED_ MODEL - HEADER_
PROXY_ E2EE - HEADER_
PROXY_ ERROR_ CODE - HEADER_
PROXY_ KEY_ BINDING - HEADER_
PROXY_ NVIDIA_ VERIFIED - HEADER_
PROXY_ SESSION_ ID - HEADER_
PROXY_ SESSION_ SCOPE - HEADER_
PROXY_ TDX_ DEBUG - HEADER_
PROXY_ TDX_ VERIFIED - HEADER_
PROXY_ TEE_ PROVIDER - HEADER_
PROXY_ TOOL_ MODE - HEADER_
PROXY_ TOOL_ RETRIES
Functions§
- apply_
error_ headers - Applies proxy error metadata headers to an HTTP error response.
- router
- Builds the HTTP router using the configured Venice API key environment variable.
- router_
with_ venice_ client - Builds the HTTP router with an already-constructed Venice client.
- serve
- Serves an already-built router on an already-bound listener.