Skip to main content

Module lexer

polydat_grammar

Module lexer 

Source
Expand description

Lexer for the Polydat DSL.

Tokenizes .polydat source text into a flat token stream. The grammar is line-oriented but the lexer doesn’t enforce line structure — that’s the parser’s job.

Structs§

Span
A source location for error reporting.
Token
A token with its source location.

Enums§

TokenKind
The kinds of token the lexer produces.

Functions§

lex
Lex source text into tokens.