Structs§
- Token
- Parsed token. It doesn’t contain information about data that has been parsed, only the type of the token and its size.
Enums§
- Base
- Base of numeric literal encoding according to its prefix.
- Literal
Kind - Token
Kind
Functions§
- tokenize
- Creates an iterator that produces tokens from the input string.