Module token 

Structured analysis tokens and end-of-stream position state.

Structs

AnalysisToken

AnalyzedText

A complete analyzed input with explicit token graph and source end state.