Function chunk 

pub fn chunk(text: &[u8]) -> Chunker<'_> 

Chunk text at delimiter boundaries.

Returns a builder that can be configured with .size() and .delimiters(), or used directly as an iterator with defaults (4KB chunks, \n.? delimiters).

• For 1-3 delimiters: uses SIMD-accelerated memchr
• For 4+ delimiters: uses lookup table

Example

use chunk::chunk;

let text = b"First sentence. Second sentence. Third sentence.";

// With defaults
let chunks: Vec<_> = chunk(text).collect();

// With custom size
let chunks: Vec<_> = chunk(text).size(1024).collect();

// With custom delimiters
let chunks: Vec<_> = chunk(text).delimiters(b"\n.?!").collect();

// With both
let chunks: Vec<_> = chunk(text).size(8192).delimiters(b"\n").collect();