Expand description
Bock lexer — tokenization of Bock source files into a token stream
Modules§
- vocab
- Introspection APIs for the lexer vocabulary.
Structs§
- Lexer
- The Bock lexer: advances through a
SourceFileand produces a token stream. - Token
- A single lexical token with its kind, source span, and optional literal text.
Enums§
- Token
Kind - The kind of a lexical token.
Functions§
- keyword_
lookup - Map a source identifier string to its keyword
TokenKind, if any.