Struct tantivy::tokenizer::WhitespaceTokenizer
source · pub struct WhitespaceTokenizer { /* private fields */ }
Expand description
Tokenize the text by splitting on whitespaces.
Trait Implementations§
source§impl Clone for WhitespaceTokenizer
impl Clone for WhitespaceTokenizer
source§fn clone(&self) -> WhitespaceTokenizer
fn clone(&self) -> WhitespaceTokenizer
Returns a copy of the value. Read more
1.0.0 · source§fn clone_from(&mut self, source: &Self)
fn clone_from(&mut self, source: &Self)
Performs copy-assignment from
source
. Read moresource§impl Default for WhitespaceTokenizer
impl Default for WhitespaceTokenizer
source§fn default() -> WhitespaceTokenizer
fn default() -> WhitespaceTokenizer
Returns the “default value” for a type. Read more
source§impl Tokenizer for WhitespaceTokenizer
impl Tokenizer for WhitespaceTokenizer
§type TokenStream<'a> = WhitespaceTokenStream<'a>
type TokenStream<'a> = WhitespaceTokenStream<'a>
The token stream returned by this Tokenizer.
source§fn token_stream<'a>(&'a mut self, text: &'a str) -> WhitespaceTokenStream<'a>
fn token_stream<'a>(&'a mut self, text: &'a str) -> WhitespaceTokenStream<'a>
Creates a token stream for a given
str
.Auto Trait Implementations§
impl Freeze for WhitespaceTokenizer
impl RefUnwindSafe for WhitespaceTokenizer
impl Send for WhitespaceTokenizer
impl Sync for WhitespaceTokenizer
impl Unpin for WhitespaceTokenizer
impl UnwindSafe for WhitespaceTokenizer
Blanket Implementations§
source§impl<T> BorrowMut<T> for Twhere
T: ?Sized,
impl<T> BorrowMut<T> for Twhere
T: ?Sized,
source§fn borrow_mut(&mut self) -> &mut T
fn borrow_mut(&mut self) -> &mut T
Mutably borrows from an owned value. Read more
source§impl<T> Downcast for Twhere
T: Any,
impl<T> Downcast for Twhere
T: Any,
source§fn into_any(self: Box<T>) -> Box<dyn Any>
fn into_any(self: Box<T>) -> Box<dyn Any>
Convert
Box<dyn Trait>
(where Trait: Downcast
) to Box<dyn Any>
. Box<dyn Any>
can
then be further downcast
into Box<ConcreteType>
where ConcreteType
implements Trait
.source§fn into_any_rc(self: Rc<T>) -> Rc<dyn Any>
fn into_any_rc(self: Rc<T>) -> Rc<dyn Any>
Convert
Rc<Trait>
(where Trait: Downcast
) to Rc<Any>
. Rc<Any>
can then be
further downcast
into Rc<ConcreteType>
where ConcreteType
implements Trait
.source§fn as_any(&self) -> &(dyn Any + 'static)
fn as_any(&self) -> &(dyn Any + 'static)
Convert
&Trait
(where Trait: Downcast
) to &Any
. This is needed since Rust cannot
generate &Any
’s vtable from &Trait
’s.source§fn as_any_mut(&mut self) -> &mut (dyn Any + 'static)
fn as_any_mut(&mut self) -> &mut (dyn Any + 'static)
Convert
&mut Trait
(where Trait: Downcast
) to &Any
. This is needed since Rust cannot
generate &mut Any
’s vtable from &mut Trait
’s.