Expand description
What the lexer cuts a source into: tokens, each with where it is.
Structs§
- Span
- Where something is in its source: byte offsets,
start..end. A byte range of the source. - Token
- A token and where it is.
Enums§
- Punct
- Punctuation and operators, longest first where one starts another.
- StrPart
- A part of a string literal: text as written, or
{expr}cut into tokens. - Tok
- What a token is.
Constants§
- QUOTE
- What a character literal is between and a lifetime starts with
(
'R','a).