pub struct Token<'t> { /* private fields */ }
Expand description
A finished token with all information set. The main difference to IncompleteToken is that all the information is frozen.
Implementations§
Source§impl<'t> Token<'t>
impl<'t> Token<'t>
Sourcepub fn to_owned_token(&self) -> Token
pub fn to_owned_token(&self) -> Token
Converts this token to an owned equivalent.
Sourcepub fn word(&self) -> &Word<'t>
pub fn word(&self) -> &Word<'t>
The word of this token. Contains information about the actual text and part-of-speech tags + lemmas.
Sourcepub fn has_space_before(&self) -> bool
pub fn has_space_before(&self) -> bool
Whether this token has one or more whitespace characters before.
Trait Implementations§
impl<'t> StructuralPartialEq for Token<'t>
Auto Trait Implementations§
impl<'t> Freeze for Token<'t>
impl<'t> RefUnwindSafe for Token<'t>
impl<'t> Send for Token<'t>
impl<'t> Sync for Token<'t>
impl<'t> Unpin for Token<'t>
impl<'t> UnwindSafe for Token<'t>
Blanket Implementations§
Source§impl<T> BorrowMut<T> for Twhere
T: ?Sized,
impl<T> BorrowMut<T> for Twhere
T: ?Sized,
Source§fn borrow_mut(&mut self) -> &mut T
fn borrow_mut(&mut self) -> &mut T
Mutably borrows from an owned value. Read more