Module lexer 

Functions

classify_keyword

Classify an identifier string as a keyword or plain IDENT.

is_ident_char

Returns true if the character at pos is valid in an ink identifier.

is_ink_ident_codepoint

Check whether a Unicode codepoint is in the ink identifier character set.

lex

Lex source into a sequence of (SyntaxKind, slice) pairs.

lex_punctuation

Try to lex punctuation starting at pos. Returns (kind, advance). Handles all greedy multi-char disambiguation.

scan_ident

Scan forward from pos while bytes form identifier characters (letters, digits, underscore, or valid Unicode ranges).