stream-chunkrec 0.1.0

Recombine LLM streaming token deltas into stable text. Buffers partial words, handles UTF-8 fragments across chunks. Zero deps.
Documentation 
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15

# stream-chunkrec

[![crates.io](https://img.shields.io/crates/v/stream-chunkrec.svg)](https://crates.io/crates/stream-chunkrec)

UTF-8-safe streaming recombiner. Buffers the trailing partial codepoint
between pushes so multi-byte chars never turn into replacement chars.

```rust
use stream_chunkrec::Recombiner;
let mut r = Recombiner::new();
assert_eq!(r.push(&[0x63, 0x61, 0x66, 0xC3]), "caf");  // "café" split
assert_eq!(r.push(&[0xA9]), "é");
```

Zero deps. MIT or Apache-2.0.