Crate koto_lexer 

Contains the lexer used by the Koto language

Structs

LexedToken

A Token along with additional metadata

Lexer

The lexer used by the Koto parser

Position

Represents a line/column position in a script

RawStringDelimiter

The delimiter used by a raw string

Span

A span is a range in the source code, represented by a start and end position

Enums

StringQuote

The type of quotation mark used in string delimiters

StringType

The string types that the lexer can produce

Token

The tokens that can emerge from the lexer

Functions

is_id_continue

Returns true if the character matches the XID_Continue Unicode property

is_id_start

Returns true if the character matches the XID_Start Unicode property