Skip to main content

lex

Function lex 

Source
pub fn lex(src: &str) -> Vec<Lexeme<'_>>
Expand description

Tokenise src into a lossless stream of lexemes.