Skip to main content

split_text_into_chunks

Function split_text_into_chunks 

Source
pub fn split_text_into_chunks(text: &str, max_len: usize) -> Vec<String>
Expand description

Split text into chunks of at most max_len characters.

Tries to break at the last newline, then the last space within the window. Trims leading/trailing whitespace from each chunk.

use oxios_markdown::parser::split_text_into_chunks;
let chunks = split_text_into_chunks("Hello world how are you", 11);
assert!(chunks.len() > 1);
for chunk in &chunks {
    assert!(chunk.len() <= 11);
}