Module asn1_compiler::tokenizer

source ·
Expand description

ASN.1 Tokenizer and Related Types Tokenizer for an ASN.1 module

Structs

Token
A parsed token before AST is created.

Functions

tokenize
Tokenize ASN file.
tokenize_string
Tokenize a String