passerine::compiler::lex
pub fn lex(source: Rc<Source>) -> Result<Vec<Spanned<Token>>, Syntax>
Simple function that lexes a source file into a token stream. Exposes the functionality of the Lexer.
Lexer