Struct tantivy::tokenizer::RawTokenizer
source · pub struct RawTokenizer { /* private fields */ }
Expand description
For each value of the field, emit a single unprocessed token.
Trait Implementations§
source§impl Clone for RawTokenizer
impl Clone for RawTokenizer
source§fn clone(&self) -> RawTokenizer
fn clone(&self) -> RawTokenizer
Returns a copy of the value. Read more
1.0.0 · source§fn clone_from(&mut self, source: &Self)
fn clone_from(&mut self, source: &Self)
Performs copy-assignment from
source
. Read moresource§impl Default for RawTokenizer
impl Default for RawTokenizer
source§fn default() -> RawTokenizer
fn default() -> RawTokenizer
Returns the “default value” for a type. Read more
source§impl Tokenizer for RawTokenizer
impl Tokenizer for RawTokenizer
§type TokenStream<'a> = RawTokenStream<'a>
type TokenStream<'a> = RawTokenStream<'a>
The token stream returned by this Tokenizer.
source§fn token_stream<'a>(&'a mut self, text: &str) -> RawTokenStream<'a>
fn token_stream<'a>(&'a mut self, text: &str) -> RawTokenStream<'a>
Creates a token stream for a given
str
.Auto Trait Implementations§
impl Freeze for RawTokenizer
impl RefUnwindSafe for RawTokenizer
impl Send for RawTokenizer
impl Sync for RawTokenizer
impl Unpin for RawTokenizer
impl UnwindSafe for RawTokenizer
Blanket Implementations§
source§impl<T> BorrowMut<T> for Twhere
T: ?Sized,
impl<T> BorrowMut<T> for Twhere
T: ?Sized,
source§fn borrow_mut(&mut self) -> &mut T
fn borrow_mut(&mut self) -> &mut T
Mutably borrows from an owned value. Read more
source§impl<T> Downcast for Twhere
T: Any,
impl<T> Downcast for Twhere
T: Any,
source§fn into_any(self: Box<T>) -> Box<dyn Any>
fn into_any(self: Box<T>) -> Box<dyn Any>
Convert
Box<dyn Trait>
(where Trait: Downcast
) to Box<dyn Any>
. Box<dyn Any>
can
then be further downcast
into Box<ConcreteType>
where ConcreteType
implements Trait
.source§fn into_any_rc(self: Rc<T>) -> Rc<dyn Any>
fn into_any_rc(self: Rc<T>) -> Rc<dyn Any>
Convert
Rc<Trait>
(where Trait: Downcast
) to Rc<Any>
. Rc<Any>
can then be
further downcast
into Rc<ConcreteType>
where ConcreteType
implements Trait
.source§fn as_any(&self) -> &(dyn Any + 'static)
fn as_any(&self) -> &(dyn Any + 'static)
Convert
&Trait
(where Trait: Downcast
) to &Any
. This is needed since Rust cannot
generate &Any
’s vtable from &Trait
’s.source§fn as_any_mut(&mut self) -> &mut (dyn Any + 'static)
fn as_any_mut(&mut self) -> &mut (dyn Any + 'static)
Convert
&mut Trait
(where Trait: Downcast
) to &Any
. This is needed since Rust cannot
generate &mut Any
’s vtable from &mut Trait
’s.