lex

Function lex 

Source
pub fn lex(input: &str) -> Vec<Token>