Enum full_moon::tokenizer::TokenKind[][src]

#[non_exhaustive]
pub enum TokenKind {
    Eof,
    Identifier,
    MultiLineComment,
    Number,
    Shebang,
    SingleLineComment,
    StringLiteral,
    Symbol,
    Whitespace,
}
Expand description

The kind of token. Contains no additional data.

Variants (Non-exhaustive)

This enum is marked as non-exhaustive
Non-exhaustive enums could have additional variants added in future. Therefore, when matching against variants of non-exhaustive enums, an extra wildcard arm must be added to account for any future variants.
Eof

End of file, should always be the very last token

Identifier

An identifier, such as foo

MultiLineComment

A multi line comment in the format of --[[ comment ]]

Number

A literal number, such as 3.3

Shebang

The shebang line

SingleLineComment

A single line comment, such as -- comment

StringLiteral

A literal string, such as “Hello, world”

Symbol

A Symbol, such as local or +

Whitespace

Whitespace, such as tabs or new lines

Trait Implementations

Returns a copy of the value. Read more

Performs copy-assignment from source. Read more

Formats the value using the given formatter. Read more

This method tests for self and other values to be equal, and is used by ==. Read more

This method tests for !=.

Auto Trait Implementations

Blanket Implementations

Gets the TypeId of self. Read more

Immutably borrows from an owned value. Read more

Mutably borrows from an owned value. Read more

Performs the conversion.

Performs the conversion.

The resulting type after obtaining ownership.

Creates owned data from borrowed data, usually by cloning. Read more

🔬 This is a nightly-only experimental API. (toowned_clone_into)

recently added

Uses borrowed data to replace owned data, usually by cloning. Read more

The type returned in the event of a conversion error.

Performs the conversion.

The type returned in the event of a conversion error.

Performs the conversion.