Enum TokenType 

pub enum TokenType {
    For,
    In,
    Require,
    Provide,
    Struct,
    Class,
    Match,
    WithHandlers,
    Raise,
    Identifier,
    Number,
    String,
    Boolean,
    LParen,
    RParen,
    LBracket,
    RBracket,
    LBrace,
    RBrace,
    Comma,
    Dot,
    Colon,
    Semicolon,
    Plus,
    Minus,
    Multiply,
    Divide,
    Modulo,
    Equals,
    NotEquals,
    LessThan,
    LessThanOrEqual,
    GreaterThan,
    GreaterThanOrEqual,
    And,
    Or,
    Not,
    Comment,
    Whitespace,
    Eof,
}

Token types for the Racket language lexer.

This enum represents all possible token types in Racket, including keywords, identifiers, literals, punctuation, and operators.

Variants

For

For keyword for iteration.

In

In keyword for iteration context.

Require

Require keyword for module imports.

Provide

Provide keyword for module exports.

Struct

Struct keyword for structure definitions.

Class

Class keyword for class definitions.

Match

Match keyword for pattern matching.

WithHandlers

With-handlers keyword for exception handling.

Raise

Raise keyword for raising exceptions.

Identifier

Identifier token.

Number

Number literal token.

String

String literal token.

Boolean

Boolean literal token.

LParen

Left parenthesis (.

RParen

Right parenthesis ).

LBracket

Left bracket [.

RBracket

Right bracket ].

LBrace

Left brace {.

RBrace

Right brace }.

Comma

Comma ,.

Dot

Dot ..

Colon

Colon :.

Semicolon

Semicolon ;.

Plus

Plus operator +.

Minus

Minus operator -.

Multiply

Multiply operator *.

Divide

Divide operator /.

Modulo

Modulo operator %.

Equals

Equality operator =.

NotEquals

Inequality operator !=.

LessThan

Less than operator <.

LessThanOrEqual

Less than or equal operator <=.

GreaterThan

Greater than operator >.

GreaterThanOrEqual

Greater than or equal operator >=.

And

Logical and operator and.

Or

Logical or operator or.

Not

Logical not operator not.

Comment

Comment token.

Whitespace

Whitespace token.

Eof

End of file token.

Trait Implementations

impl Clone for TokenType

fn clone(&self) -> TokenType

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Debug for TokenType

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl From<TokenType> for ElementType

fn from(token_type: TokenType) -> Self

Converts to this type from the input type.

impl Hash for TokenType

fn hash<__H: Hasher>(&self, state: &mut __H)

Feeds this value into the given Hasher.

fn hash_slice<H>(data: &[Self], state: &mut H)

where H: Hasher, Self: Sized,

Feeds a slice of this type into the given Hasher.

impl PartialEq for TokenType

fn eq(&self, other: &TokenType) -> bool

Tests for self and other values to be equal, and is used by ==.

fn ne(&self, other: &Rhs) -> bool

Tests for !=. The default implementation is almost always sufficient, and should not be overridden without very good reason.

impl TokenType for TokenType

const END_OF_STREAM: Self = TokenType::Eof

A constant representing the end of the input stream.

type Role = UniversalTokenRole

The associated role type for this token kind.

fn role(&self) -> Self::Role

Returns the general syntactic role of this token.

fn is_role(&self, role: Self::Role) -> bool

Returns true if this token matches the specified language-specific role.

fn is_universal(&self, role: UniversalTokenRole) -> bool

Returns true if this token matches the specified universal role.

fn is_comment(&self) -> bool

Returns true if this token represents a comment.

fn is_whitespace(&self) -> bool

Returns true if this token represents whitespace.

fn is_error(&self) -> bool

Returns true if this token represents an error condition.

fn is_ignored(&self) -> bool

Returns true if this token represents trivia (whitespace, comments, etc.).

fn is_end_of_stream(&self) -> bool

Returns true if this token represents the end of the input stream.

impl Copy for TokenType

impl Eq for TokenType

impl StructuralPartialEq for TokenType