Skip to main content

split_into_chunks_by_token_offsets

Function split_into_chunks_by_token_offsets 

Source
pub fn split_into_chunks_by_token_offsets(
    body: &str,
    token_offsets: &[(usize, usize)],
) -> Vec<Chunk>