pub fn tokenize(input: &str) -> Result<Vec<Token>, LexError>
Tokenize input into a Vec<Token> ending in Token::Eof.
input
Vec<Token>
Token::Eof