Module antlr_rust::token_factory[][src]

Expand description

How Lexer should produce tokens

Structs

This is a wrapper for Token factory that allows to allocate tokens in separate arena. It can allow to significantly improve performance by passing Tokens by references everywhere.

Default token factory

Token factory that produces heap allocated OwningTokens

Traits

Trait for creating tokens.

Type Definitions

Arena token factory that contains CommonTokens

Arena token factory that contains OwningTokens