Skip to main content

split_into_chunks

Function split_into_chunks 

Source
pub fn split_into_chunks(content: &str, policy: &ChunkPolicy) -> Vec<Chunk>
Expand description

Pure: split content into chunks under policy. No I/O, no time, no model. The output is a list of non-overlapping byte spans, ordered by position, that cover the input up to the policy’s hard-cut tail.