Module lex

defines and implements Lexer (Tokenizer).

Structs

Lexer

Lexes a source code and iterates tokens.

LexerRunner

Lexerは使い捨てなので、Runnerを用意

SimpleLexer

Enums

Interpolation

OpFix

Quote

Traits

Lexable