Enum Token 

pub enum Token {
    Number(f64),
    Str(String),
    Var(String),
    Ident(String),
    LParen,
    RParen,
    Comma,
    CmdOpen,
    CmdClose,
    BraceOpen,
    BraceClose,
    Plus,
    Minus,
    Star,
    Slash,
    Percent,
    Gte,
    Lte,
    Gt,
    Lt,
    EqEq,
    Neq,
    AndAnd,
    OrOr,
    Bang,
    Eq,
    Colon,
    Arrow,
    FatArrow,
    BodyStart,
    NodeEnd,
    Hash,
    Newline,
}

A lexical token produced by the lexer.

Variants

Number(f64)

Floating-point or integer literal.

Str(String)

Double-quoted string literal.

Var(String)

Variable beginning with $.

Ident(String)

Plain identifier or keyword.

LParen

( – opens a parenthesised sub-expression or argument list.

RParen

) – closes a parenthesised sub-expression or argument list.

Comma

, – argument separator.

CmdOpen

<< – opens a command/statement block.

CmdClose

>> – closes a command/statement block.

BraceOpen

{ – opens an inline expression.

BraceClose

} – closes an inline expression.

Plus

+

Minus

-

Star

*

Slash

/

Percent

%

Gte

>=

Lte

<=

Gt

>

Lt

<

EqEq

==

Neq

!=

AndAnd

&&

OrOr

||

Bang

!

Eq

= (used in <<set $x = …>>)

Colon

:

Arrow

->

FatArrow

=>

BodyStart

--- body-start delimiter.

NodeEnd

=== node-end delimiter.

Hash

# tag prefix.

Newline

Newline.

Trait Implementations

impl Clone for Token

fn clone(&self) -> Token

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Debug for Token

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl<'s> Logos<'s> for Token

type Error = ()

Error type returned by the lexer. This can be set using #[logos(error = MyError)]. Defaults to () if not set.

type Extras = ()

Associated type Extras for the particular lexer. This can be set using #[logos(extras = MyExtras)] and accessed inside callbacks.

type Source = str

Source type this token can be lexed from. This will default to str, unless one of the defined patterns explicitly uses non-unicode byte values or byte slices, in which case that implementation will use [u8].

fn lex( lex: &mut Lexer<'s, Self>, ) -> Option<Result<Self, <Self as Logos<'s>>::Error>>

The heart of Logos. Called by the Lexer. The implementation for this function is generated by the logos-derive crate.

fn lexer(source: &'source Self::Source) -> Lexer<'source, Self>

where Self::Extras: Default,

Create a new instance of a Lexer that will produce tokens implementing this Logos.

fn lexer_with_extras( source: &'source Self::Source, extras: Self::Extras, ) -> Lexer<'source, Self>

Create a new instance of a Lexer with the provided Extras that will produce tokens implementing this Logos.

impl PartialEq for Token

fn eq(&self, other: &Token) -> bool

Tests for self and other values to be equal, and is used by ==.

fn ne(&self, other: &Rhs) -> bool

Tests for !=. The default implementation is almost always sufficient, and should not be overridden without very good reason.

impl StructuralPartialEq for Token