List of all items

Structs

• tokenizers::FingerprintTokenizer
• tokenizers::WordToken
• tokenizers::WordTokenizer
• tokenizers::WordTokenizerBuilder
• tokenizers::WordTokens

Enums

• tokenizers::WordTokenKind

Traits

• tokenizers::NgramsIteratorExt

Functions

• keyers::omission_key
• stemmers::fr::carry_stemmer
• stemmers::s_stemmer
• tokenizers::is_junk
• tokenizers::ngrams_len
• tokenizers::ngrams_range_len
• tokenizers::split_hashtag
• tokenizers::split_paragraphs
• tokenizers::split_sentences
• utils::reduce_lengthening