#[non_exhaustive]
pub enum TokenKind {
Eof,
Identifier,
MultiLineComment,
Number,
Shebang,
SingleLineComment,
StringLiteral,
Symbol,
Whitespace,
}
Expand description
The kind of token. Contains no additional data.
Variants (Non-exhaustive)
This enum is marked as non-exhaustive
Non-exhaustive enums could have additional variants added in future. Therefore, when matching against variants of non-exhaustive enums, an extra wildcard arm must be added to account for any future variants.
Eof
End of file, should always be the very last token
Identifier
An identifier, such as foo
MultiLineComment
A multi line comment in the format of --[[ comment ]]
Number
A literal number, such as 3.3
Shebang
The shebang line
SingleLineComment
A single line comment, such as -- comment
StringLiteral
A literal string, such as “Hello, world”
Symbol
A Symbol
, such as local
or +
Whitespace
Whitespace, such as tabs or new lines
Trait Implementations
Auto Trait Implementations
impl RefUnwindSafe for TokenKind
impl UnwindSafe for TokenKind
Blanket Implementations
Mutably borrows from an owned value. Read more