Crate perl_module_token_core 

Shared primitives for Perl module token parsing and boundary detection.

This microcrate owns the grammar-level mechanics used by token parsing and standalone token matching:

• module token shape parsing (Foo::Bar, Foo'Bar, etc.)
• boundary checks to avoid partial identifier matches

Structs

ModuleTokenSpan

Byte span for a parsed module token.

Functions

has_standalone_module_token_boundaries

Check if a span from start to end is bounded as a standalone token.

is_module_identifier_char

Check whether ch belongs to Perl module identifier characters.

is_module_token_char

Check whether ch belongs to the module token character class.

parse_module_token

Parse a module token that starts at start in text.