lex

Function lex 

Source
pub fn lex(s: &str) -> (Token, usize)