Skip to main content

Module lexer

Module lexer 

Source
Expand description

Tokenizer for the object-extended lambda calculus surface syntax.

Spike 3 adds four tokens beyond spike 2: LBrace ({), RBrace (}), Comma (,), and the KwExtend keyword.

Structs§

Token
A token paired with its source position.

Enums§

TokenKind
The syntactic kind of a token.

Functions§

lex
Lex the entire source string into a vector of tokens.