Expand description
llm-stream-accumulator: accumulate LLM streaming chunks into a final response.
use llm_stream_accumulator::StreamAccumulator;
let mut acc = StreamAccumulator::new();
acc.push_text("Hello");
acc.push_text(", world");
acc.push_text("!");
assert_eq!(acc.text(), "Hello, world!");
assert!(!acc.is_complete());
acc.finish();
assert!(acc.is_complete());Structs§
- Stream
Accumulator - Accumulated result of a streaming LLM response.
- Tool
Call - Accumulated tool-use call.
Enums§
- Chunk
- A single streamed chunk.