Expand description
Backend-neutral lexical tokens.
Tokens contain only their kind and source span. The original spelling is
intentionally not copied: use Token::text with the source query when a
lossless representation is needed.
Structs§
- Token
- A token produced by the lexer.