Module tokenizer
ftml
Take an input string and produce a list of tokens for consumption by the parser.