Module erg_parser::lex

source · [−]

Expand description

defines and implements Lexer (Tokenizer).

Structs

Lexes a source code and iterates tokens.

Lexerは使い捨てなので、Runnerを用意