pub fn create_tokenizer(model_name_or_path: &str) -> Result<Arc<dyn Tokenizer>>Expand description
Factory function to create tokenizer from a model name or path (blocking version)
This delegates to create_tokenizer_with_chat_template_blocking with no chat template,
which handles both local files and HuggingFace Hub downloads uniformly.