pub struct Token { /* private fields */ }
Expand description
Represents a single token produced during the tokenization process.
Each Token
consists of a string value
and its corresponding TokenType
, which categorizes the token.
§Fields
token_value
: A string containing the actual content of the token.token_type
: The type of the token, as defined by theTokenType
enum.
Trait Implementations§
Auto Trait Implementations§
impl Freeze for Token
impl RefUnwindSafe for Token
impl Send for Token
impl Sync for Token
impl Unpin for Token
impl UnwindSafe for Token
Blanket Implementations§
Source§impl<T> BorrowMut<T> for Twhere
T: ?Sized,
impl<T> BorrowMut<T> for Twhere
T: ?Sized,
Source§fn borrow_mut(&mut self) -> &mut T
fn borrow_mut(&mut self) -> &mut T
Mutably borrows from an owned value. Read more