Expand description
This file contains the lexer trait, which is able to work for the normal lexer, but also for the source and macro lexers, alongside possible other implementations.
Traitsยง
- Lexer
Base - Every lexer implements LexerBase and next_token allows to move to the next token of a given stream, until the end has been reached.