Skip to main content

forward_text_stream

Function forward_text_stream 

Source
pub async fn forward_text_stream<S>(task_id: impl Into<String>, stream: S)
where S: Stream<Item = String> + Unpin,
Expand description

Drain any Stream<Item = String> (e.g. a mapped LLM completion) into emit_token calls.