[][src]Module mamba::lex

Modules

lex_result
token

Functions

tokenize

Convert a given string to a sequence of TokenPos, each containing a Token, in addition to line number and position. Note that line number and position are 1-indexed.

tokenize_all

Type Definitions

TokenizeInput