[][src]Crate lualexer

A lexer that reads Lua code and produces tokens. The crate provide two different lexers:

  • FastLexer: skips all the whitespace tokens
  • FullLexer: produces every tokens

Structs

FastTokenizer
FullTokenizer
Lexer

This struct wraps the tokenizer to offer a simple interface to parse a string.

Token

A small struct that contains minimal information about a slice of the input. The token does not own the part of the code that it represents, it only keeps a reference to the original input.

Enums

LexerErrorType

Errors that can happen while tokenizing some input.

TokenType

The different type of tokens that will be produced by the lexer

Type Definitions

FastLexer

A lexer that skips all the information about whitespaces.

FullLexer

A lexer that keeps the information about whitespaces.

LexerError

When the lexer encounters an error, it returns the error type and the rest of the given input that was not parsed.