Skip to main content

AnyTokenizer

Type Alias AnyTokenizer 

Source
pub type AnyTokenizer = TypedTokenizer<AnyGrammar>;
Expand description

Tokenizer alias for grammar-independent code that picks grammar at runtime.

This is a type alias for TypedTokenizer<AnyGrammar>.

Aliased Type§

pub struct AnyTokenizer { /* private fields */ }