Lexical analyzer (tokenizer) for Cypher query language
Converts raw Cypher text into a stream of tokens for parsing.