Struct Normalizer 

pub struct Normalizer { /* private fields */ }

WeText Normalizer

Main entry point for text normalization functionality. Supports Text Normalization (TN) and Inverse Text Normalization (ITN) for Chinese, English, and Japanese.

Example

use wetext_rs::{Normalizer, NormalizerConfig, Language};

let config = NormalizerConfig::new().with_lang(Language::Zh);
let mut normalizer = Normalizer::new("path/to/fsts", config);
let result = normalizer.normalize("2024年").unwrap();
// Result: "二零二四年"

Implementations

impl Normalizer

pub fn new<P: AsRef<Path>>(fst_dir: P, config: NormalizerConfig) -> Self

Create a new Normalizer

Arguments

• fst_dir - Directory containing FST weight files
• config - Normalizer configuration

pub fn with_defaults<P: AsRef<Path>>(fst_dir: P) -> Self

Create a Normalizer with default configuration

pub fn normalize(&mut self, text: &str) -> Result<String>

Normalize text using the configured settings

pub fn normalize_with_config( &mut self, text: &str, config: &NormalizerConfig, ) -> Result<String>

Normalize text with a specific configuration