Module punct 

This module contains types for punctuation tokens. These are used to represent single and multi character punctuation tokens. For single character punctuation tokens, there are there are PunctAny, PunctAlone and PunctJoint types.

Structs

PunctAlone

A single character punctuation token which is not followed by another punctuation character.

PunctAny

A single character punctuation token with any kind of Spacing,

PunctJoint

A single character punctuation token where the lexer joined it with the next Punct or a single quote followed by a identifier (rust lifetime).

Enums

Spacing

Whether a Punct is followed immediately by another Punct or followed by another token or whitespace.