Function mako::tokenization::hf_tokenizers::tokenizer::normalizer::bytes_to_char

source · [−]
pub fn bytes_to_char(s: &str, range: Range<usize>) -> Option<Range<usize>>
Expand description

Convert the given range from bytes to char