Skip to main content

tokenize

Function tokenize 

Source
pub fn tokenize(text: &str) -> Vec<String>
Expand description

Tokenizes text with the same stemming and stop-word behavior used by search.