Module moore_common::lexer
source · [−]Expand description
Lexer utilities.
Structs
A buffered lexer that allows tokens to be peeked at before they are actually consumed.
A lexer chaining the tokens of multiple other lexers after another. Lexers can be pushed onto an internal stack and will then be queried for tokens until their respective Eof has been reached. At that point, the lexer is popped off the stack and the next lexer’s tokens are produced. An Eof is returned once all lexers have been drained.