Skip to main content

split_chunks

Function split_chunks 

Source
pub fn split_chunks(text: &str, config: &SplitConfig) -> Vec<TextChunk>
Expand description

Split text into chunks with configuration.

First splits into sentences, then merges/splits to respect size limits.