logo
Expand description

This module contains the code for the lexer.

It is kind of shared with parser.rs, which implements the lex_next_token based on the macro_rules that declares token

Structs

Traits

This trait is used by the crate::parser::lex_next_token function and is implemented for rule passed to the macro which can be either a string literal, or a function

Functions