pub struct Token {
pub kind: TokenKind,
pub file_id: u8,
pub source_index: u32,
pub len: u16,
}
Expand description
Produced by the lexer, it is the smallest element that can be parsed, it contains the token’s data and position in the source code
The ID of the file this token belongs to
The index into the file’s source that this token is
The length of the token in the source
Creates a new Span that envelopes just this token
Performs copy-assignment from
source
.
Read more
Formats the value using the given formatter.
Read more
This method tests for self
and other
values to be equal, and is used
by ==
.
This method tests for !=
. The default implementation is almost always
sufficient, and should not be overridden without very good reason.
Immutably borrows from an owned value.
Read more
Mutably borrows from an owned value.
Read more
Returns the argument unchanged.
Calls U::from(self)
.
That is, this conversion is whatever the implementation of
From<T> for U
chooses to do.
The resulting type after obtaining ownership.
Creates owned data from borrowed data, usually by cloning.
Read more
Uses borrowed data to replace owned data, usually by cloning.
Read more
The type returned in the event of a conversion error.
Performs the conversion.
The type returned in the event of a conversion error.
Performs the conversion.