Enum dedukti_parse::Token

pub enum Token<S> {
    Def,
    Thm,
    LBrk,
    RBrk,
    LPar,
    RPar,
    Colon,
    ColonEq,
    Arrow,
    FatArrow,
    LongArrow,
    Comma,
    Dot,
    Symb(Symb<S>),
    Comment(usize),
    Error,
}

A token generated by the lexer.

Variants

Def

Thm

LBrk

RBrk

LPar

RPar

Colon

ColonEq

Arrow

FatArrow

LongArrow

Comma

Dot

Symb(Symb<S>)

Comment(usize)

Error

Trait Implementations

impl<S: Debug> Debug for Token<S>

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl<S: Display> Display for Token<S>

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl<'s> Logos<'s> for Token<&'s str>

type Extras = ()

Associated type Extras for the particular lexer. This can be set using #[logos(extras = MyExtras)] and accessed inside callbacks.

type Source = str

Source type this token can be lexed from. This will default to str, unless one of the defined patterns explicitly uses non-unicode byte values or byte slices, in which case that implementation will use [u8].

const ERROR: Self = Token { #[token("def")] Def, #[token("thm")] Thm, #[token("[")] LBrk, #[token("]")] RBrk, #[token("(")] LPar, #[token(")")] RPar, #[token(":")] Colon, #[token(":=")] ColonEq, #[token("->")] Arrow, #[token("=>")] FatArrow, #[token("-->")] LongArrow, #[token(",")] Comma, #[token(".")] Dot, #[regex("[a-zA-Z0-9_!?][a-zA-Z0-9_!?']*", symb)] #[token("{|", moustache)] Symb(Symb), #[token("(;", comment1)] Comment(usize), // Logos requires one token variant to handle errors, // it can be named anything you wish. #[regex(r"[ \t\n\f]+", logos::skip)] #[error] Error

Helper const of the variant marked as #[error].

fn lex(lex: &mut Lexer<'s, Self>)

The heart of Logos. Called by the Lexer. The implementation for this function is generated by the logos-derive crate.

fn lexer(source: &'source Self::Source) -> Lexer<'source, Self> where
    Self::Extras: Default, 

Create a new instance of a Lexer that will produce tokens implementing this Logos.

fn lexer_with_extras(
    source: &'source Self::Source,
    extras: Self::Extras
) -> Lexer<'source, Self>

Create a new instance of a Lexer with the provided Extras that will produce tokens implementing this Logos.

impl<S: PartialEq> PartialEq<Token<S>> for Token<S>

fn eq(&self, other: &Token<S>) -> bool

This method tests for self and other values to be equal, and is used by ==.

fn ne(&self, other: &Token<S>) -> bool

This method tests for !=.

impl<S: Eq> Eq for Token<S>

impl<S> StructuralEq for Token<S>

impl<S> StructuralPartialEq for Token<S>