Module state 

Tokenizer state management and issue reporting

Provides context tracking and error reporting for the ASS tokenizer. Maintains parsing state and accumulates issues during lexical analysis.

Structs

IssueCollector

Issue collector for accumulating tokenization problems

TokenIssue

Tokenization issue for error reporting

Enums

IssueLevel

Token issue severity levels

TokenContext

Tokenization context for state-aware parsing