elasticlunr::pipeline
pub fn tokenize(text: &str) -> Vec<String>
Splits a text string into a vector of individual tokens.