Enum Token 

#[non_exhaustive]
pub enum Token {
    Ident(String),
    Str(String),
    Number(f64),
    Eq,
    NotEq,
    WordMatch,
    PrefixMatch,
    StartsWith,
    EndsWith,
    Contains,
    Lt,
    Gt,
    Lte,
    Gte,
    LBracket,
    RBracket,
    LParen,
    RParen,
    Comma,
    Dot,
    Star,
    Hash,
    Colon,
    DoubleColon,
    Plus,
    Tilde,
    Bang,
    Semicolon,
    Null,
    True,
    False,
    Not,
    Is,
    And,
    Or,
    Custom(String),
}

Lexical token produced by tokenize().

Variants (Non-exhaustive)

Non-exhaustive enums could have additional variants added in future. Therefore, when matching against variants of non-exhaustive enums, an extra wildcard arm must be added to account for any future variants.

Ident(String)

Identifier: unquoted name (method, async, count).

Str(String)

Quoted string literal.

Number(f64)

Numeric literal (parsed to f64).

Eq

=

NotEq

!=

WordMatch

~=

PrefixMatch

|=

StartsWith

^=

EndsWith

$=

Contains

*=

Lt

<

Gt

>

Lte

<=

Gte

>=

LBracket

[

RBracket

]

LParen

(

RParen

)

Comma

,

Dot

.

Star

* (standalone, not *=)

Hash

#

Colon

:

DoubleColon

::

Plus

+ (standalone, not inside an operator)

Tilde

~ (standalone, not ~=)

Bang

! (standalone, not !=)

Semicolon

;

Null

Keyword null

True

Keyword true

False

Keyword false

Not

Keyword not

Is

Keyword is

And

Keyword and

Or

Keyword or

Custom(String)

Consumer-defined token from Tokenizer::op() or Tokenizer::keyword().

Trait Implementations

impl Clone for Token

fn clone(&self) -> Token

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Debug for Token

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl PartialEq for Token

fn eq(&self, other: &Token) -> bool

Tests for self and other values to be equal, and is used by ==.

fn ne(&self, other: &Rhs) -> bool

Tests for !=. The default implementation is almost always sufficient, and should not be overridden without very good reason.

impl Serialize for Token

fn serialize<__S>(&self, __serializer: __S) -> Result<__S::Ok, __S::Error>

where __S: Serializer,

Serialize this value into the given Serde serializer.

impl StructuralPartialEq for Token