chunk-flush 0.1.0

Flush-on-newline buffer for streaming LLM output. Holds bytes until a newline or N millis pass, then yields a complete chunk. Zero deps.
Documentation
  • Coverage
  • 100%
    6 out of 6 items documented1 out of 6 items with examples
  • Size
  • Source code size: 17.81 kB This is the summed size of all the files inside the crates.io package for this release.
  • Documentation size: 299.92 kB This is the summed size of all files generated by rustdoc for all configured targets
  • Ø build duration
  • this release: 15s Average build duration of successful builds.
  • all releases: 15s Average build duration of successful builds in releases after 2024-10-23.
  • Links
  • Homepage
  • MukundaKatta/chunk-flush
    0 0 0
  • crates.io
  • Dependencies
  • Versions
  • Owners
  • MukundaKatta

chunk-flush

crates.io

Flush-on-newline buffer for streaming LLM output. Holds chars until a newline or the size cap, then emits a chunk.

use chunk_flush::Flusher;
let mut f = Flusher::new(500);
let out = f.push("hello world\n");

Zero deps. MIT or Apache-2.0.