Enum full_moon::tokenizer::TokenKind [−][src]
#[non_exhaustive] pub enum TokenKind { Eof, Identifier, MultiLineComment, Number, Shebang, SingleLineComment, StringLiteral, Symbol, Whitespace, }
Expand description
The kind of token. Contains no additional data.
Variants (Non-exhaustive)
This enum is marked as non-exhaustive
Non-exhaustive enums could have additional variants added in future. Therefore, when matching against variants of non-exhaustive enums, an extra wildcard arm must be added to account for any future variants.
End of file, should always be the very last token
An identifier, such as foo
A multi line comment in the format of --[[ comment ]]
A literal number, such as 3.3
The shebang line
A single line comment, such as -- comment
A literal string, such as “Hello, world”
A Symbol
, such as local
or +
Whitespace, such as tabs or new lines
Trait Implementations
Auto Trait Implementations
impl RefUnwindSafe for TokenKind
impl UnwindSafe for TokenKind
Blanket Implementations
Mutably borrows from an owned value. Read more