Skip to main content

backend_api_handler

lean_ctx::proxy::chatgpt

Function backend_api_handler 

Source 
pub async fn backend_api_handler(
    __arg0: State<ProxyState>,
    req: Request<Body>,
) -> Result<Response, StatusCode>
Expand description

ChatGPT backend calls outside the model rail are not model JSON and must not be compressed or cost-metered. They are credential-preserving passthroughs.