Crate koto_lexer

source ·
Expand description

Contains the lexer used by the Koto language

Structs§

  • A Token along with additional metadata
  • The lexer used by the Koto parser
  • Represents a line/column position in a script
  • The delimiter used by a raw string
  • A span is a range in the source code, represented by a start and end position

Enums§

  • The type of quotation mark used in string delimiters
  • The string types that the lexer can produce
  • The tokens that can emerge from the lexer

Functions§

  • Returns true if the character matches the XID_Continue Unicode property
  • Returns true if the character matches the XID_Start Unicode property