Struct tantivy::tokenizer::TextAnalyzerBuilder
source · pub struct TextAnalyzerBuilder<T = Box<dyn BoxableTokenizer>> { /* private fields */ }
Expand description
Builder helper for TextAnalyzer
Implementations§
source§impl<T: Tokenizer> TextAnalyzerBuilder<T>
impl<T: Tokenizer> TextAnalyzerBuilder<T>
sourcepub fn filter<F: TokenFilter>(
self,
token_filter: F
) -> TextAnalyzerBuilder<F::Tokenizer<T>>
pub fn filter<F: TokenFilter>( self, token_filter: F ) -> TextAnalyzerBuilder<F::Tokenizer<T>>
Appends a token filter to the current builder.
§Example
use tantivy::tokenizer::*;
let en_stem = TextAnalyzer::builder(SimpleTokenizer::default())
.filter(RemoveLongFilter::limit(40))
.filter(LowerCaser)
.filter(Stemmer::default())
.build();
sourcepub fn dynamic(self) -> TextAnalyzerBuilder
pub fn dynamic(self) -> TextAnalyzerBuilder
Boxes the internal tokenizer. This is useful for adding dynamic filters. Note: this will be less performant than the non boxed version.
sourcepub fn filter_dynamic<F: TokenFilter>(
self,
token_filter: F
) -> TextAnalyzerBuilder
pub fn filter_dynamic<F: TokenFilter>( self, token_filter: F ) -> TextAnalyzerBuilder
Appends a token filter to the current builder and returns a boxed version of the
tokenizer. This is useful when you want to build a TextAnalyzer
dynamically.
Prefer using TextAnalyzer::builder(tokenizer).filter(token_filter).build()
if
possible as it will be more performant and create less boxes.
sourcepub fn build(self) -> TextAnalyzer
pub fn build(self) -> TextAnalyzer
Finalize building the TextAnalyzer
Auto Trait Implementations§
impl<T> Freeze for TextAnalyzerBuilder<T>where
T: Freeze,
impl<T> RefUnwindSafe for TextAnalyzerBuilder<T>where
T: RefUnwindSafe,
impl<T> Send for TextAnalyzerBuilder<T>where
T: Send,
impl<T> Sync for TextAnalyzerBuilder<T>where
T: Sync,
impl<T> Unpin for TextAnalyzerBuilder<T>where
T: Unpin,
impl<T> UnwindSafe for TextAnalyzerBuilder<T>where
T: UnwindSafe,
Blanket Implementations§
source§impl<T> BorrowMut<T> for Twhere
T: ?Sized,
impl<T> BorrowMut<T> for Twhere
T: ?Sized,
source§fn borrow_mut(&mut self) -> &mut T
fn borrow_mut(&mut self) -> &mut T
Mutably borrows from an owned value. Read more
source§impl<T> Downcast for Twhere
T: Any,
impl<T> Downcast for Twhere
T: Any,
source§fn into_any(self: Box<T>) -> Box<dyn Any>
fn into_any(self: Box<T>) -> Box<dyn Any>
Convert
Box<dyn Trait>
(where Trait: Downcast
) to Box<dyn Any>
. Box<dyn Any>
can
then be further downcast
into Box<ConcreteType>
where ConcreteType
implements Trait
.source§fn into_any_rc(self: Rc<T>) -> Rc<dyn Any>
fn into_any_rc(self: Rc<T>) -> Rc<dyn Any>
Convert
Rc<Trait>
(where Trait: Downcast
) to Rc<Any>
. Rc<Any>
can then be
further downcast
into Rc<ConcreteType>
where ConcreteType
implements Trait
.source§fn as_any(&self) -> &(dyn Any + 'static)
fn as_any(&self) -> &(dyn Any + 'static)
Convert
&Trait
(where Trait: Downcast
) to &Any
. This is needed since Rust cannot
generate &Any
’s vtable from &Trait
’s.source§fn as_any_mut(&mut self) -> &mut (dyn Any + 'static)
fn as_any_mut(&mut self) -> &mut (dyn Any + 'static)
Convert
&mut Trait
(where Trait: Downcast
) to &Any
. This is needed since Rust cannot
generate &mut Any
’s vtable from &mut Trait
’s.