Skip to main content

forward_openai_streaming

Function forward_openai_streaming 

Source
pub async fn forward_openai_streaming(
    client: &Client,
    base: &str,
    headers: &HeaderMap,
    body: Bytes,
) -> Result<(StatusCode, HeaderMap, Response), ProxyError>
Expand description

Forward one POST /v1/chat/completions request and return the raw response for streaming relay.

ยงErrors

Returns ProxyError::Upstream on a transport-level failure.