Skip to main content

chunk_text

Function chunk_text 

Source
pub fn chunk_text(content: &str, target: usize) -> Result<Vec<TextChunk>>
Expand description

Paragraph-aware chunking. Fenced code and tables are atomic, even above the target size. A long prose line may span chunks sharing that same line number.