Struct CharNormalizer 

pub struct CharNormalizer {
    pub form: NormalizationForm,
    pub strip_controls: bool,
    pub normalize_whitespace_flag: bool,
}

Applies Unicode normalization passes to strings and character sequences.

Fields

form: NormalizationForm

Which normalization form to apply.

strip_controls: bool

Strip control characters.

normalize_whitespace_flag: bool

Map all Unicode whitespace to ASCII space.

Implementations

impl CharNormalizer

pub fn new(form: NormalizationForm) -> Self

Create a normalizer.

pub fn with_strip_controls(self) -> Self

Enable control-char stripping.

pub fn with_normalize_whitespace(self) -> Self

Enable whitespace normalization.

pub fn normalize(&self, input: &str) -> String

Apply the pipeline to input.

pub fn normalize_char(&self, c: char) -> Vec<char>

Normalize a single character (best-effort, returns the char unchanged).

pub fn description(&self) -> String

Human-readable description.

Trait Implementations

impl Clone for CharNormalizer

fn clone(&self) -> CharNormalizer

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Debug for CharNormalizer

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.