Skip to main content

split_into_chunks

Function split_into_chunks 

Source
pub fn split_into_chunks(body: &str) -> Vec<Chunk>
Expand description

Splits body into overlapping Chunks using a character-based heuristic.

Short bodies (≤ CHUNK_SIZE_CHARS) are returned as a single chunk. Splits prefer paragraph breaks, then sentence-end punctuation, then word boundaries.

§Errors

This function is infallible; it returns a Vec directly.