Enum Token 

pub enum Token {
    Null,
    Bool(bool),
    Integer(i64),
    Float(f64),
    Date(String),
    DateTime(String),
    QuotedStr(String),
    Word(String),
    Op(Operator),
    LParen,
    RParen,
    Comma,
    Semi,
}

A single lexical token.

Literals are typed at lex time: null/true/false become their own variants; unquoted digit sequences become Integer or Float. This avoids re-scanning in the grammar layer.

Variants

Null

The bare keyword null.

Bool(bool)

The bare keyword true or false.

Integer(i64)

An unquoted integer literal (no .).

Float(f64)

An unquoted floating-point literal (contains .).

Date(String)

An unquoted date literal matching YYYY-MM-DD.

DateTime(String)

An unquoted datetime literal matching YYYY-MM-DDTHH:MM:SSZ.

QuotedStr(String)

A single- or double-quoted string (quotes stripped, no escape processing).

Word(String)

An unquoted identifier or bare-string value (not a keyword or number).

Op(Operator)

A matched operator from the OPERATORS table.

LParen

(

RParen

)

Comma

, — OR separator at expression level; element separator inside lists.

Semi

; — AND separator.

Trait Implementations

impl Clone for Token

fn clone(&self) -> Token

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Debug for Token

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl PartialEq for Token

fn eq(&self, other: &Token) -> bool

Tests for self and other values to be equal, and is used by ==.

fn ne(&self, other: &Rhs) -> bool

Tests for !=. The default implementation is almost always sufficient, and should not be overridden without very good reason.

impl StructuralPartialEq for Token