Module antlr_rust::token [−][src]
Expand description
Symbols that parser works on
Structs
Constants
Shorthand for TOKEN_HIDDEN_CHANNEL
Default channel lexer emits tokens to
Type of EOF token
Type of tokens that DFA can use to advance to next state without consuming actual input token. Should not be created by downstream implementations.
Predefined additional channel for lexer to assign tokens to
Type of tokens that parser considers invalid
Min token type that can be assigned to tokens created by downstream implementations.
Traits
Implemented by tokens that are produced by a TokenFactory
Type Definitions
Most versatile Token that uses Cow to save data Can be used seamlessly switch from owned to zero-copy parsing
Token that owns its data