Enum TokenType 

pub enum TokenType {
    OpenParen,
    CloseParen,
    OpenBrace,
    CloseBrace,
    OpenBracket,
    CloseBracket,
    Comma,
    Dot,
    Minus,
    Plus,
    Semicolon,
    Slash,
    Star,
    Colon,
    Percent,
    Pipe,
    Bang,
    Question,
    At,
    Dollar,
    Underscore,
    StarStar,
    ColonColon,
    Arrow,
    FatArrow,
    PipeArrow,
    DotDot,
    DotDotEq,
    NotEqual,
    Equal,
    EqualEqual,
    Greater,
    GreaterEqual,
    Less,
    LessEqual,
    PlusEqual,
    MinusEqual,
    StarEqual,
    SlashEqual,
    PercentEqual,
    Identifier,
    Error,
    String,
    FString,
    RawString,
    Number,
    Doc,
    And,
    Break,
    Class,
    Const,
    Continue,
    Else,
    Enum,
    False,
    For,
    Fn,
    If,
    In,
    Match,
    Nil,
    Not,
    Or,
    Pub,
    Raise,
    Return,
    Super,
    Self_,
    True,
    Let,
    Use,
    While,
    AI,
    Prompt,
    Agent,
    Invalid,
    Eof,
}

Represents different types of tokens in the language

Variants

OpenParen

CloseParen

OpenBrace

CloseBrace

OpenBracket

CloseBracket

Comma

Dot

Minus

Plus

Semicolon

Slash

Star

Colon

Percent

Pipe

Bang

Question

At

Dollar

Underscore

StarStar

ColonColon

Arrow

FatArrow

PipeArrow

DotDot

DotDotEq

NotEqual

Equal

EqualEqual

Greater

GreaterEqual

Less

LessEqual

PlusEqual

MinusEqual

StarEqual

SlashEqual

PercentEqual

Identifier

Error

String

FString

RawString

Number

Doc

And

Break

Class

Const

Continue

Else

Enum

False

For

Fn

If

In

Match

Nil

Not

Or

Pub

Raise

Return

Super

Self_

True

Let

Use

While

AI

Prompt

Agent

Invalid

Eof

Trait Implementations

impl Clone for TokenType

fn clone(&self) -> TokenType

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Debug for TokenType

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl Hash for TokenType

fn hash<__H: Hasher>(&self, state: &mut __H)

Feeds this value into the given Hasher.

fn hash_slice<H>(data: &[Self], state: &mut H)

where H: Hasher, Self: Sized,

Feeds a slice of this type into the given Hasher.

impl PartialEq for TokenType

fn eq(&self, other: &TokenType) -> bool

Tests for self and other values to be equal, and is used by ==.

fn ne(&self, other: &Rhs) -> bool

Tests for !=. The default implementation is almost always sufficient, and should not be overridden without very good reason.

impl Copy for TokenType

impl Eq for TokenType

impl StructuralPartialEq for TokenType