Enum TokenKind 

pub enum TokenKind {
    If,
    Else,
    Loop,
    While,
    For,
    In,
    Break,
    Continue,
    Return,
    Throw,
    Global,
    Import,
    As,
    Is,
    Not,
    And,
    Or,
    Try,
    Fn,
    Do,
    Null,
    True,
    False,
    DoubleColon,
    Eq,
    NotEq,
    LtEq,
    GtEq,
    AddAssign,
    SubAssign,
    MulAssign,
    DivAssign,
    ModAssign,
    Comma,
    Dot,
    OpenParen,
    CloseParen,
    OpenBrace,
    CloseBrace,
    OpenBracket,
    CloseBracket,
    Pound,
    Question,
    Colon,
    Assign,
    Lt,
    Gt,
    VBar,
    Add,
    Sub,
    Mul,
    Div,
    Mod,
    EOL,
    LineComment,
    BlockComment,
    Whitespace,
    Ident(String),
    Literal(LiteralKind),
    Unknown(char),
}

Enum representing common lexeme types.

Variants

If

“if”

Else

“else”

Loop

“loop”

While

“while”

For

“for”

In

“in”

Break

“break”

Continue

“continue”

Return

“return”

Throw

“throw”

Global

“global”

Import

“import”

As

“as”

Is

“is”

Not

“not”

And

“and”

Or

“or”

Try

“try”

Fn

“fn”

Do

“do”

Null

“null”

True

“true”

False

“false”

DoubleColon

“::”

Eq

“==”

NotEq

“!=”

LtEq

“<=”

GtEq

“>=”

AddAssign

“+=”

SubAssign

“-=”

MulAssign

“*=”

DivAssign

“/=”

ModAssign

“%=”

Comma

“,”

Dot

“.”

OpenParen

“(”

CloseParen

“)”

OpenBrace

“{”

CloseBrace

“}”

OpenBracket

“[”

CloseBracket

“]”

Pound

“#”

Question

“?”

Colon

“:”

Assign

“=”

Lt

“<”

Gt

“>”

VBar

“|”

Add

“+”

Sub

“-”

Mul

“*”

Div

“/”

Mod

“%”

EOL

End of line (\n)

LineComment

“// comment”

BlockComment

“/* block comment */”

Block comments can be recursive, so the sequence like /* /* */ will not be considered terminated and will result in a parsing error.

Whitespace

Any whitespace characters sequence.

Ident(String)

Ident

Literal(LiteralKind)

“12”, “1.0e-40”, ““123”“. See LiteralKind for more details.

Unknown(char)

Unknown token, not expected by the lexer, e.g. “№”

Trait Implementations

impl Clone for TokenKind

fn clone(&self) -> TokenKind

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Debug for TokenKind

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl Display for TokenKind

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl PartialEq for TokenKind

fn eq(&self, other: &TokenKind) -> bool

Tests for self and other values to be equal, and is used by ==.

fn ne(&self, other: &Rhs) -> bool

Tests for !=. The default implementation is almost always sufficient, and should not be overridden without very good reason.

impl StructuralPartialEq for TokenKind