Enum full_moon::tokenizer::TokenKind

pub enum TokenKind {
    Eof,
    Identifier,
    MultiLineComment,
    Number,
    SingleLineComment,
    StringLiteral,
    Symbol,
    Whitespace,
}

The kind of token. Contains no additional data.

Variants

Eof

End of file, should always be the very last token

Identifier

An identifier, such as foo

MultiLineComment

A multi line comment in the format of --[[ comment ]]

Number

A literal number, such as 3.3

SingleLineComment

A single line comment, such as -- comment

StringLiteral

A literal string, such as "Hello, world"

Symbol

A Symbol, such as local or +

Whitespace

Whitespace, such as tabs or new lines

Trait Implementations

impl Clone for TokenKind

fn clone(&self) -> TokenKind

Returns a copy of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Copy for TokenKind

impl Debug for TokenKind

fn fmt(&self, f: &mut Formatter) -> Result

Formats the value using the given formatter.

impl Eq for TokenKind

impl PartialEq<TokenKind> for TokenKind

fn eq(&self, other: &TokenKind) -> bool

This method tests for self and other values to be equal, and is used by ==.

#[must_use]fn ne(&self, other: &Rhs) -> bool

This method tests for !=.

impl StructuralEq for TokenKind

impl StructuralPartialEq for TokenKind