Module token

Source
Expand description

All functionality for turning scripts into series of tokens.

Modules§

number
Functionality for parsing numbers, including managing operations with arbitrary precision.

Structs§

Ampersant
A ‘&’ token.
Asterisk
A ‘*’ token.
At
A ‘@’ token.
Caret
A ‘^’ token.
Colon
A ‘:’ token.
Comma
A ‘,’ token.
Dollar
A ‘$’ token.
Dot
A ‘.’ token.
Eq
A ‘=’ token.
Exclamation
A ‘!’ token.
Gt
A ‘>’ token.
Gteq
A ‘>=’ token.
LBrace
A ‘{’ token.
LParen
A ‘(’ token.
LSquare
A ‘[’ token.
Let
A ‘let’ token.
Lt
A ‘<’ token.
Lteq
A ‘<=’ token.
Minus
A ‘-’ token.
NamedIdent
A name identifier, as opposed to a point collection identifier. For more details, see PointCollection
Plus
A ‘+’ token.
PointCollection
A point collection composed of single point identifiers. A point identifier is an uppercase alphabetic character and a number of ' characters following it.
PointCollectionItem
An item of a point collection.
Position
Defines a position in the script.
Question
A ‘?’ token.
RBrace
A ‘}’ token.
RParen
A ‘)’ token.
RSquare
A ‘]’ token.
Semi
A ‘;’ token.
Slash
A ‘/’ token.
Span
Defines a span in the script.
StrLit
A string, delimited by quotation marks.
TokFloat
A decimal number.
TokInteger
An integer.
Vertical
A ‘|’ token.

Enums§

Ident
An identifier. Either a point collection or a name.
NumberLit
A number token. Can represent an integer or a decimal.
Token
Any valid token of GeoScript

Functions§

tokenize
Tokenizes the given script (turns it into a series of tokens).