Module lexer

This module contains the code for the lexer.

It is kind of shared with parser.rs, which implements the lex_next_token based on the macro_rules that declares token

Structs

LexState

Traits

LexingRule

This trait is used by the crate::parser::lex_next_token function and is implemented for rule passed to the macro which can be either a string literal, or a function

Functions

lex

lex_color

lex_comment

lex_identifier

lex_number

lex_string

lex_whitespace