Module lexer 

SQL Lexer - Tokenization of SQL queries

This module handles the conversion of raw SQL text into tokens that can be consumed by the parser.

Structs

Lexer

Enums

LexerMode

Lexer mode - controls whether comments are preserved or skipped

Token