plrs 0.1.3

The multi-tool of lexical analysis and tokenization.
Documentation
  • Coverage
  • 50%
    1 out of 2 items documented0 out of 1 items with examples
  • Size
  • Source code size: 13.39 kB This is the summed size of all the files inside the crates.io package for this release.
  • Documentation size: 338.81 kB This is the summed size of all files generated by rustdoc for all configured targets
  • Ø build duration
  • this release: 17s Average build duration of successful builds.
  • all releases: 17s Average build duration of successful builds in releases after 2024-10-23.
  • Links
  • JakeRoggenbuck/plrs
    1 0 2
  • crates.io
  • Dependencies
  • Versions
  • Owners
  • JakeRoggenbuck

plrs Version

The multi-tool of lexical analysis and tokenization.

Install

pip install plrs

Build

maturin build

Examples

API

Global variables

EOF_TOKEN

Classes

Tokens
Settings
Token
  - part
  - token
  - set_part
  - set_token
  - __str__
  - __repr__

Lexer
  - new
  - char_forward
  - skip_over_char_set
  - next

Functions

is_char_symbol
is_char_operator
is_char_whitespace
is_char_numeric
is_single_quote
is_double_quote
ends_token
is_part_numeric
tokenize