Lexer (tokenizer) for FiddlerScript.
The lexer transforms source code into a stream of tokens that can be consumed by the parser.