Skip to main content

create_streaming_client

Function create_streaming_client 

Source
pub fn create_streaming_client() -> Client
Expand description

Create an HTTP client optimized for streaming.

Streaming intentionally has no whole-request timeout: a chat completion that trickles tokens for longer than the request budget is healthy, not hung. The connect phase stays bounded, and callers that need a stall detector should set an idle/read_timeout instead of a total deadline.