Function passerine::compiler::lex::lex[][src]

pub fn lex(source: Rc<Source>) -> Result<Vec<Spanned<Token>>, Syntax>
Expand description

Simple function that lexes a source file into a token stream. Exposes the functionality of the Lexer.