Skip to main content

generate_stream

offline_intelligence::api::stream_api

Function generate_stream 

Source 
pub async fn generate_stream(
    __arg0: State<UnifiedAppState>,
    __arg1: Json<StreamChatRequest>,
) -> Response
Expand description

POST /generate/stream — Main streaming chat endpoint

  1. Validates request and gets/creates session in shared memory
  2. Persists user message to database
  3. Streams LLM response back via SSE
  4. Persists assistant response to database after completion