Function load_tokenizer 

pub fn load_tokenizer(model: &Path) -> Result<Tokenizer>

The model’s tokenizer: tokenizer.json, or rebuilt from a GGUF file’s vocabulary.