Module lexer 

Tiny hand-written tokenizer for array DDL/DML.

Scope is limited to the four ARRAY statements — identifiers, integer/float literals, single-quoted strings, parentheses, brackets, commas, dots, double-dots, and a handful of keywords. Keywords are left as Ident tokens; the parser handles them case-insensitively.

Structs

Token

Enums

Tok

Functions

tokenize

Tokenize a SQL slice. Returns Vec<Token> on success; any unexpected character produces SqlError::Parse.