Crate husk_lexer

Crate husk_lexer 

Source
Expand description

Lexical analysis: convert source text into a stream of tokens.

Structs§

Lexer
Simple lexer over a UTF-8 string.
Span
A span in the source file, represented as a byte range.
Token
A token with its kind, source span, and associated trivia.

Enums§

Keyword
Language keywords (subset for the MVP).
TokenKind
Token kinds produced by the lexer.
Trivia
Trivia represents non-semantic content: whitespace and comments. Used by the formatter to preserve comments and intentional blank lines.

Constants§

KEYWORDS
List of all Husk keywords.

Functions§

is_keyword
Check if a string is a Husk reserved keyword.
is_valid_identifier
Check if a string is a valid Husk identifier.