Module luthor::token [] [src]

Token-related types.

Structs

Token

A lexeme and category pairing. Tokens are the final product of a lexer; their lexemes should join to produce the original data passed to the lexer.

Enums

Category

The primary means of classifying a format or language's lexemes.