Struct UnicodeLanguageDetector 

pub struct UnicodeLanguageDetector { /* private fields */ }

Detect language from Unicode character ranges.

Supports CJK disambiguation (JA vs ZH) by checking for kana presence. Latin characters are mapped to a configurable default language.

Implementations

impl UnicodeLanguageDetector

pub fn new(languages: &[String], default_latin_language: &str) -> Self

Create a new detector for the given set of languages.

default_latin_language controls which language Latin-script characters (A-Z, a-z, accented Latin) are assigned to.

pub fn detect_char(&self, ch: char, context_has_kana: bool) -> Option<&str>

Detect language for a single character.

context_has_kana is used for CJK ideograph disambiguation: if the surrounding text contains kana, CJK ideographs are classified as Japanese rather than Chinese.

Returns None for neutral characters (whitespace, digits, ASCII punctuation, etc.).

pub fn has_kana(&self, text: &str) -> bool

Check if text contains any Hiragana or Katakana characters.