Module lexer

Source

Structs§

TokenIter
An iterator over the tokens of a string. Used by Parser.

Enums§

Token
Tokens understood by the parser.

Functions§

strip_whitespace_and_line_cont
Removes whitespace and line continuation token (if any) from the end of a line, returning whether there was a line continuation token.