default_tokenizers

Function default_tokenizers 

Source
pub fn default_tokenizers() -> [(String, TextAnalyzer); 8]
Expand description

Instantiate default tokenizers