Enum TokenKind 

pub enum TokenKind {
    Ident,
    Number,
    String,
    Directive,
    RulePrefixMarker,
    At,
    Newline,
    Indent(u32),
    Eof,
    LParen,
    RParen,
    LBracket,
    RBracket,
    LBrace,
    RBrace,
    Comma,
    Colon,
    Dot,
    Assign,
    Plus,
    Minus,
    Star,
    Slash,
    Percent,
    DoubleStar,
    PlusAssign,
    MinusAssign,
    StarAssign,
    SlashAssign,
    PercentAssign,
    DoubleStarAssign,
    Eq,
    Ne,
    Lt,
    Le,
    Gt,
    Ge,
    LexBang,
}

The kind of a token.

Variants

Ident

An identifier or keyword (keywords are resolved by the parser).

Number

A numeric literal (text holds the source spelling).

String

A string literal (text holds the unescaped value).

Directive

A #! directive line (text holds everything after #!).

RulePrefixMarker

A preprocessing marker carrying the rule-prefix state active at the following top-level rule or subroutine.

At

@Event / @Condition / other @ directives.

Newline

Indent(u32)

Indentation change: the column of the current line.

Eof

End of file.

LParen

RParen

LBracket

RBracket

LBrace

RBrace

Comma

Colon

Dot

Assign

Plus

Minus

Star

Slash

Percent

DoubleStar

PlusAssign

MinusAssign

StarAssign

SlashAssign

PercentAssign

DoubleStarAssign

Eq

Ne

Lt

Le

Gt

Ge

LexBang

A bare ! that is not !=; the parser rejects it as unsupported OPY.

Trait Implementations

impl Clone for TokenKind

fn clone(&self) -> TokenKind

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Copy for TokenKind

impl Debug for TokenKind

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl Eq for TokenKind

impl PartialEq for TokenKind

fn eq(&self, other: &TokenKind) -> bool

Equality operator ==.

fn ne(&self, other: &Rhs) -> bool

Inequality operator !=.

impl StructuralPartialEq for TokenKind