luau-lexer 0.2.91

A lexer for the luau language.
Documentation 
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27

# Luau Lexer


A lossless lexer for the luau programming language. Lexes source code into
tokens while preserving all spaces and comments.

## Usage


```rust
use luau_lexer::prelude::{Lexer, TokenType};
let code = r#"local foo = "Hello, World!""#;
let mut lexer = Lexer::new(code);
let mut token = lexer.next_token();

loop {
    println!("{token:?}");
    if token == TokenType::EndOfFile {
        break;
    }

    token = lexer.next_token();
}
```

## Note


* This lexer does not stop parsing when it finds an error
* This lexer only lexes each token when asked to do so.