Skip to main content

Crate lualexer

Crate lualexer 

Source
Expand description

A lexer that reads Lua code and produces tokens. The crate provide two different lexers:

  • FastLexer: skips all the whitespace tokens
  • FullLexer: produces every tokens

Structs§

FastTokenizer
FullTokenizer
Lexer
This struct wraps the tokenizer to offer a simple interface to parse a string.
Token
A small struct that contains minimal information about a slice of the input. The token does not own the part of the code that it represents, it only keeps a reference to the original input.

Enums§

LexerErrorType
Errors that can happen while tokenizing some input.
TokenType
The different type of tokens that will be produced by the lexer

Type Aliases§

FastLexer
A lexer that skips all the information about whitespaces.
FullLexer
A lexer that keeps the information about whitespaces.
LexerError
When the lexer encounters an error, it returns the error type and the rest of the given input that was not parsed.