luau-lexer 0.2.6

A lexer for the luau language.
Documentation 
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22

# Luau Lexer


A lossless lexer for the luau programming language. Lexes source code into
tokens while preserving all spaces and comments.

## Usage


```rust
use luau_lexer::prelude::{Lexer, TokenType};
let code = r#"local foo = "Hello, World!""#;
let mut lexer = Lexer::new(code);
let mut token = lexer.next_token();
while token != TokenType::EndOfFile {
    println!("{token:?}");
    token = lexer.next_token();
}
```

## Note


* This lexer does not stop parsing when it finds an error
* This lexer only lexes each token when asked to do so.