[−][src]Trait tantivy::tokenizer::TokenFilter
Trait for the pluggable components of Tokenizer
s.
Required methods
fn transform<'a>(&self, token_stream: BoxTokenStream<'a>) -> BoxTokenStream<'a>
Wraps a token stream and returns the modified one.