Module tokenizer 

ICL Tokenizer — converts ICL text into token stream

Handles: keywords, identifiers, string literals, integer/float literals, ISO8601 timestamps, UUIDs, symbols (braces, colons, commas, brackets). Comments (//) are discarded.

Guarantees:

• Deterministic: same input always produces same token stream
• Complete error reporting: line:column for every error

Structs

Span

Position in source text for error reporting

SpannedToken

Token with source position

Tokenizer

Tokenizer for ICL source text

Enums

Token

Token types for ICL syntax