Expand description
Text preprocessing utilities
This module provides functionality for text normalization, cleaning, and other preprocessing operations.
Structs§
- Basic
Normalizer - Basic text normalizer that handles case folding and unicode normalization
- Basic
Text Cleaner - Text cleaner for removing special characters, extra whitespace, and stopwords
- Text
Preprocessor - Pipeline for text preprocessing that combines normalization and cleaning
Traits§
- Text
Cleaner - Trait for text cleaning operations
- Text
Normalizer - Trait for text normalization operations