Module antlr_rust::token_factory
source · [−]Expand description
How Lexer should produce tokens
Structs
This is a wrapper for Token factory that allows to allocate tokens in separate arena. It can allow to significantly improve performance by passing Tokens by references everywhere.
Default token factory
Token factory that produces heap allocated
OwningTokens
Traits
Trait for creating tokens.
Type Definitions
Arena token factory that contains CommonTokens
Arena token factory that contains OwningTokens