Skip to main content

passage_token_offsets

Function passage_token_offsets 

Source
pub fn passage_token_offsets(
    tokenizer: &Tokenizer,
    text: &str,
) -> Result<Vec<(usize, usize)>, AppError>