Struct LanguageConfig 

pub struct LanguageConfig {
    pub matcher: fn(char) -> bool,
    pub chars_per_token: f64,
}

A language-specific rule that adjusts characters-per-token when matched.

The matcher function is called for each character in a word segment. If it returns true for any character, the segment uses chars_per_token instead of the default ratio.

Fields

matcher: fn(char) -> bool

Character-level predicate that detects the language.

chars_per_token: f64

Average characters per token for this language.

Trait Implementations

impl Clone for LanguageConfig

fn clone(&self) -> LanguageConfig

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.