Function tokenize

pub fn tokenize(input: &str) -> Lexer<'_, TokenKind> 

Returns an iterator over the token kinds produced by the tokenizer.