rust-lexer 0.2.0

A compiler that generates a Lexer using DFAs (inspired by flex)
Documentation
  • Coverage
  • 0%
    0 out of 82 items documented0 out of 33 items with examples
  • Size
  • Source code size: 82.19 kB This is the summed size of all the files inside the crates.io package for this release.
  • Documentation size: 4.9 MB This is the summed size of all files generated by rustdoc for all configured targets
  • Links
  • crates.io
  • Dependencies
  • Versions
  • Owners
  • CyrilSharma

rflex

This is a compiler which takes in a .tk regex specification and outputs a tokenizer. The usage is rflex [input_file] [output_file]. See example.tk and tokenizer.rs for an example input and output. Much of the design was based on the textbook: Compilers, Principles, Designs and Tools.

TODO

Make generator break when it encounters the dead state. Make generator handle variable types! It's really annoying otherwise.