[−][src]Module antlr_rust::token
Symbols that parser works on
Structs
| GenericToken |
Constants
| HIDDEN | Shorthand for TOKEN_HIDDEN_CHANNEL |
| TOKEN_DEFAULT_CHANNEL | Default channel lexer emits tokens to |
| TOKEN_EOF | Type of EOF token |
| TOKEN_EPSILON | Type of tokens that DFA can use to advance to next state without consuming actual input token. Should not be created by downstream implementations. |
| TOKEN_HIDDEN_CHANNEL | Predefined additional channel for lexer to assign tokens to |
| TOKEN_INVALID_TYPE | Type of tokens that parser considers invalid |
| TOKEN_MIN_USER_TOKEN_TYPE | Min token type that can be assigned to tokens created by downstream implementations. |
Traits
| Token | Implemented by tokens that are produced by a |
Type Definitions
| CommonToken | Most versatile Token that uses Cow to save data Can be used seamlessly switch from owned to zero-copy parsing |
| OwningToken | Token that owns its data |