Enum rual_core::syntax::TokenType

pub enum TokenType {
    Keyword(Keyword),
    Ident {
        start: usize,
        end: usize,
    },
    Num(i32),
    Str {
        start: usize,
        end: usize,
    },
    Bool(bool),
    Comment {
        start: usize,
        end: usize,
    },
    Discard,
    Punct(Punct),
    Term,
}

The various types of tokens.

Comments, strings and identifiers keep the range of their values within the source code. The start of that range is the index of the first character of the token. The end is the index after the last character of the token.

Variants

Keyword(Keyword)

Ident

Fields of Ident

start: usizeend: usize

Num(i32)

Str

Fields of Str

start: usizeend: usize

Bool(bool)

Comment

Fields of Comment

start: usizeend: usize

Discard

Punct(Punct)

Term

Methods

impl TokenType

pub fn type_eq(self, other: TokenType) -> bool

Trait Implementations

impl Clone for TokenType

fn clone(&self) -> TokenType

Returns a copy of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Copy for TokenType

impl Debug for TokenType

fn fmt(&self, f: &mut Formatter) -> Result

Formats the value using the given formatter.

impl PartialEq<TokenType> for TokenType

fn eq(&self, other: &TokenType) -> bool

This method tests for self and other values to be equal, and is used by ==.

fn ne(&self, other: &TokenType) -> bool

This method tests for !=.

impl StructuralPartialEq for TokenType