Module token

Tokens representing punctuation, identifiers, keywords, and whitespace.

Types for parsing delimited groups can be found in the group module.

The punctuation tokens can be most easily accessed using the Punct macro.

Structs

Ampersand

&

AmpersandAmpersand

&&

Asterisk

*

AsteriskEqual

*=

At

@

BackTick

`

Backslash

\

Bang

!

BangEqual

!=

Caret

^

CarriageReturn

u+000D

Colon

:

ColonColon

::

ColonColonEqual

::=

Comma

,

Dash

-

DashDash

--

DashEqual

-=

Dollar

$

Dot

.

DoubleQuote

"

Equal

=

EqualEqual

==

FatArrow

=>

Hash

#

HashHash

##

HashHashHash

###

Ident

An identifier consisting of alphanumeric characters and underscores, and starting with an alphabetic character or an underscore.

LAngle

<

LAngleEqual

<=

LAngleLAngle

<<

LAngleLAngleEqual

<<=

LThinArrow

<-

LeftBrace

{

LeftBracket

[

LeftParen

(

LitChar

A character literal delimited by single quotes.

LitFloat

A string of ascii digits followed by a ., and then another string of ascii digits.

LitInt

An integer literal.

LitStrDoubleQuote

A string literal delimited by double quotes.

LitStrSingleQuote

A string literal delimited by single quotes.

NewLine

\n

Percent

%

PercentEqual

%=

Pipe

|

PipePipe

||

Plus

+

PlusEqual

+=

PlusPlus

++

Pound

£

Question

?

RAngle

>

RAngleEqual

>=

RAngleRAngle

>>

RAngleRAngleEqual

>>=

RThinArrow

->

RightBrace

}

RightBracket

]

RightParen

)

SemiColon

;

SingleQuote

'

Slash

/

SlashEqual

/=

SlashSlash

//

SlashSlashEqual

//=

Space2

Space4

Tab

\t

Tilde

~

Tilde2

¬

UnderScore

_

Traits

Punct

A trait for punctuation tokens.

Token

A trait for types that can be represented by a single token.