compactp_lexer 0.1.0-beta.1

Lexer for the Compact language (Midnight Network) — tokenizes UTF-8 source into a SyntaxKind stream.
Documentation 
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18

# compactp_lexer

Lexer for the Compact language (Midnight Network), part of the
[`compactp`](https://github.com/devrelaicom/compactp) parser frontend.

Tokenizes UTF-8 source bytes into a `(SyntaxKind, &str)` stream with byte offsets,
suitable for direct consumption by `compactp_parser`. Each Compact keyword has a
dedicated `_KW` `SyntaxKind`; literals and identifiers carry their text. The lexer
never panics on arbitrary input (fuzz-tested).

## Status

Beta (`0.x`). APIs may change between minor versions. See the
[compatibility matrix](https://github.com/devrelaicom/compactp#compact-compatibility).

## License

MIT