Enum Token

pub enum Token<'a> {
    Error,
    True,
    False,
    Null,
    Colon,
    Comma,
    LBrace,
    RBrace,
    LBrack,
    RBrack,
    Number(&'a str),
    String(&'a str),
    MissingEndQuote(&'a str),
}

Variants

Error

True

False

Null

Colon

Comma

LBrace

RBrace

LBrack

RBrack

Number(&'a str)

String(&'a str)

MissingEndQuote(&'a str)

Implementations

impl<'a> Token<'a>

pub fn to_lalr_triple( (t, r): (Token<'a>, Range<usize>), ) -> Result<(usize, Token<'_>, usize), CompilationError>

Trait Implementations

impl<'a> Clone for Token<'a>

fn clone(&self) -> Token<'a>

Returns a copy of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl<'a> Debug for Token<'a>

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl<'a> Display for Token<'a>

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl<'s> Logos<'s> for Token<'s>

const SIZE: usize = 13usize

SIZE is simply a number of possible variants of the Logos enum. The derive macro will make sure that all variants don’t hold values larger or equal to SIZE.

const ERROR: Self = Token::Error

Helper const of the variant marked as #[error].

type Extras = ()

Associated type Extras for the particular lexer. This can be set using #[logos(extras = MyExtras)] and accessed inside callbacks.

type Source = str

Source type this token can be lexed from. This will default to str, unless one of the defined patterns explicitly uses non-unicode byte values or byte slices, in which case that implementation will use [u8].

fn lex(lex: &mut Lexer<'s, Self>)

The heart of Logos. Called by the Lexer. The implementation for this function is generated by the logos-derive crate.

fn lexer(source: &'source Self::Source) -> Lexer<'source, Self>

Create a new instance of a Lexer that will produce tokens implementing this Logos.

impl<'a> PartialEq for Token<'a>

fn eq(&self, other: &Token<'a>) -> bool

Tests for self and other values to be equal, and is used by ==.

fn ne(&self, other: &Rhs) -> bool

Tests for !=. The default implementation is almost always sufficient, and should not be overridden without very good reason.

impl<'a> Copy for Token<'a>

impl<'a> StructuralPartialEq for Token<'a>