Expand description
Shared token model primitives and low-level helpers. Shared primitives for Perl module token parsing and boundary detection.
Structs§
- Module
Token Span - Byte span for a parsed module token.
Functions§
- has_
standalone_ module_ token_ boundaries - Check if a span from
starttoendis bounded as a standalone token. - is_
module_ identifier_ char - Check whether
chbelongs to Perl module identifier characters. - is_
module_ token_ char - Check whether
chbelongs to the module token character class. - parse_
module_ token - Parse a module token that starts at
startintext.