Module filter 

Token filters: lowercase, stop words, length constraints, stemming.

Structs

Bm25StopWordFilter

Drops the same stop words as khive-bm25’s SimpleTokenizer::default(). Scoped to preset::standard() so the public StopWordFilter stop list is unaffected. Assumes input is already lowercased.

LowercaseFilter

Lowercases tokens (Unicode-aware).

MaxLengthFilter

Drops tokens longer than max characters.

MinLengthFilter

Drops tokens shorter than min characters.

StopWordFilter

Drops the general English stop-word set; input must already be lowercase.