Skip to main content

Module preprocess

Module preprocess 

Source
Expand description

String preprocessors: zero-copy string cleanup that normalizes unicode, handles whitespace, and removes stop-words before the math happens.

Structs§

Preprocessor
Configuration for text preprocessing.

Functions§

clean
Convenience: preprocess text with default settings.
clean_with_stopwords
Convenience: preprocess and remove stopwords.