pub fn tokenize(text: &str) -> Tokenization<'_>
Take an input string and produce a list of tokens for consumption by the parser.