Module tan::lexer

Modules

• comment
• token

Structs

• Lexer
  The Lexer performs the lexical analysis stage of the compilation pipeline. The input text is scanned into lexemes and then evaluated into lexical tokens. The tokens are associated with ranges (ranges within the input text).