Enum TokenType 

pub enum TokenType {
    LeftParen,
    RightParen,
    LeftBracket,
    RightBracket,
    LeftBrace,
    RightBrace,
    Dot,
    Comma,
    Plus,
    Percent,
    Minus,
    Semicolon,
    Not,
    NotEqual,
    Equal,
    EqualEqual,
    Greater,
    GreaterEqual,
    Less,
    QuestionMark,
    LessEqual,
    Slash,
    Colon,
    RawString,
    Star,
    String,
    Bytes,
    RawBytes,
    Ident,
    Int(i64),
    Uint(u64),
    Double(f64),
    And,
    As,
    Break,
    Const,
    Else,
    False,
    For,
    Function,
    If,
    Import,
    Let,
    Loop,
    Null,
    In,
    Or,
    True,
    Var,
    Package,
    Namespace,
    Void,
    While,
    Dyn,
}

TokenType represents the type of the token. It is used by the parser to build the AST. The parser is responsible for deciding how to interpret the token.

Variants

LeftParen

RightParen

LeftBracket

RightBracket

LeftBrace

RightBrace

Dot

Comma

Plus

Percent

Minus

Semicolon

Not

NotEqual

Equal

EqualEqual

Greater

GreaterEqual

Less

QuestionMark

LessEqual

Slash

Colon

RawString

Star

String

Bytes

RawBytes

Ident

Int(i64)

Uint(u64)

Double(f64)

And

As

Break

Const

Else

False

For

Function

If

Import

Let

Loop

Null

In

Or

True

Var

Package

Namespace

Void

While

Dyn

Trait Implementations

impl Clone for TokenType

fn clone(&self) -> TokenType

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Debug for TokenType

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl Display for TokenType

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl PartialEq for TokenType

fn eq(&self, other: &TokenType) -> bool

Tests for self and other values to be equal, and is used by ==.

fn ne(&self, other: &Rhs) -> bool

Tests for !=. The default implementation is almost always sufficient, and should not be overridden without very good reason.

impl Copy for TokenType

impl StructuralPartialEq for TokenType