Module luthor::token
[−]
[src]
Token-related types.
Structs
Token |
A lexeme and category pairing. Tokens are the final product of a lexer; their lexemes should join to produce the original data passed to the lexer. |
Enums
Category |
The primary means of classifying a format or language's lexemes. |