Skip to main content

Crate llm_stream_accumulator

Crate llm_stream_accumulator 

Source
Expand description

llm-stream-accumulator: accumulate LLM streaming chunks into a final response.

use llm_stream_accumulator::StreamAccumulator;

let mut acc = StreamAccumulator::new();
acc.push_text("Hello");
acc.push_text(", world");
acc.push_text("!");
assert_eq!(acc.text(), "Hello, world!");
assert!(!acc.is_complete());
acc.finish();
assert!(acc.is_complete());

Structs§

StreamAccumulator
Accumulated result of a streaming LLM response.
ToolCall
Accumulated tool-use call.

Enums§

Chunk
A single streamed chunk.