Skip to main content

get_tokenizer

Function get_tokenizer 

Source
pub fn get_tokenizer(models_dir: &Path) -> Result<&'static Tokenizer, AppError>