Skip to main content

Crate bock_lexer

Crate bock_lexer 

Source
Expand description

Bock lexer — tokenization of Bock source files into a token stream

Modules§

vocab
Introspection APIs for the lexer vocabulary.

Structs§

Lexer
The Bock lexer: advances through a SourceFile and produces a token stream.
Token
A single lexical token with its kind, source span, and optional literal text.

Enums§

TokenKind
The kind of a lexical token.

Functions§

keyword_lookup
Map a source identifier string to its keyword TokenKind, if any.