Module token

All functionality for turning scripts into series of tokens.

Modules

• number
  Functionality for parsing numbers, including managing operations with arbitrary precision.

Structs

• Ampersant
  A ‘&’ token.
• Asterisk
  A ‘*’ token.
• At
  A ‘@’ token.
• Caret
  A ‘^’ token.
• Colon
  A ‘:’ token.
• Comma
  A ‘,’ token.
• Dollar
  A ‘$’ token.
• Dot
  A ‘.’ token.
• Eq
  A ‘=’ token.
• Exclamation
  A ‘!’ token.
• Gt
  A ‘>’ token.
• Gteq
  A ‘>=’ token.
• LBrace
  A ‘{’ token.
• LParen
  A ‘(’ token.
• LSquare
  A ‘[’ token.
• Let
  A ‘let’ token.
• Lt
  A ‘<’ token.
• Lteq
  A ‘<=’ token.
• Minus
  A ‘-’ token.
• NamedIdent
  A name identifier, as opposed to a point collection identifier. For more details, see PointCollection
• Plus
  A ‘+’ token.
• PointCollection
  A point collection composed of single point identifiers. A point identifier is an uppercase alphabetic character and a number of ' characters following it.
• PointCollectionItem
  An item of a point collection.
• Position
  Defines a position in the script.
• Question
  A ‘?’ token.
• RBrace
  A ‘}’ token.
• RParen
  A ‘)’ token.
• RSquare
  A ‘]’ token.
• Semi
  A ‘;’ token.
• Slash
  A ‘/’ token.
• Span
  Defines a span in the script.
• StrLit
  A string, delimited by quotation marks.
• TokFloat
  A decimal number.
• TokInteger
  An integer.
• Vertical
  A ‘|’ token.

Enums

• Ident
  An identifier. Either a point collection or a name.
• NumberLit
  A number token. Can represent an integer or a decimal.
• Token
  Any valid token of GeoScript

Functions

• tokenize
  Tokenizes the given script (turns it into a series of tokens).