Crate koto_lexer
source ·Expand description
Contains the lexer used by the Koto language
Structs§
- A Token along with additional metadata
- The lexer used by the Koto parser
- Represents a line/column position in a script
- The delimiter used by a raw string
- A span is a range in the source code, represented by a start and end position
Enums§
- The type of quotation mark used in string delimiters
- The string types that the lexer can produce
- The tokens that can emerge from the lexer
Functions§
- Returns true if the character matches the XID_Continue Unicode property
- Returns true if the character matches the XID_Start Unicode property