Function nlprule::tokenizer_filename

pub fn tokenizer_filename(lang_code: &str) -> String

Gets the canonical filename for the tokenizer binary for a language code in ISO 639-1 (two-letter) format.