Module streaming

Module streaming 

Source

Functionsยง

handle_streaming_request
Handles streaming chat completion requests, bypassing the semantic cache.