backyard-lexer 0.1.9

Generating tokens representation of PHP code.
Documentation 
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53

# backyard-lexer

Generating tokens representation of PHP code.

## features

- Parse string to tokens _(lex() & lex_eval())_

## usage

    fn main() {
      let arena = bumpalo::Bump::new();
      let code = r#"<?php
      function hello_world($foo) {
        var_dump($foo);
      }"#;

      let parsed = backyard_lexer::lex(&arena, code);
      println!("{:?}", parsed);
    }

Resulting this:

    Ok([
      Token { token_type: Function, value: "function", line: 2, column: 4, offset: 10 },
      Token { token_type: Identifier, value: "hello_world", line: 2, column: 13, offset: 19 },
      Token { token_type: LeftParenthesis, value: "(", line: 2, column: 24, offset: 30 },
      Token { token_type: Variable, value: "foo", line: 2, column: 25, offset: 31 },
      Token { token_type: RightParenthesis, value: ")", line: 2, column: 29, offset: 35 },
      Token { token_type: LeftCurlyBracket, value: "{", line: 2, column: 31, offset: 37 },
      Token { token_type: Identifier, value: "var_dump", line: 3, column: 6, offset: 45 },
      Token { token_type: LeftParenthesis, value: "(", line: 3, column: 14, offset: 53 },
      Token { token_type: Variable, value: "foo", line: 3, column: 15, offset: 54 },
      Token { token_type: RightParenthesis, value: ")", line: 3, column: 19, offset: 58 },
      Token { token_type: Semicolon, value: ";", line: 3, column: 20, offset: 59 },
      Token { token_type: RightCurlyBracket, value: "}", line: 4, column: 4, offset: 65 }
    ])

## ecosystem

- [backyard-nodes (Node / AST, with builder and walker)](https://crates.io/crates/backyard-nodes)
- [backyard-parser](https://crates.io/crates/backyard-parser)
- [backyard-generator](https://crates.io/crates/backyard-generator)

## heavily inspired by

- [oxc-project/oxc](https://github.com/oxc-project/oxc)
- [nikic/PHP-Parser](https://github.com/nikic/PHP-Parser)
- [glayzzle/php-parser](https://github.com/glayzzle/php-parser)

## license

[MIT](https://github.com/Alzera/backyard/blob/main/LICENSE)