op8d_lexemizer

Opinionated Rust library for transforming code to a vector of Lexemes.

Currently, only Rust edition 2018 is supported.

• Build the docs: rm -rf target/doc; cargo doc
• Read the docs: open target/doc/op8d_lexemizer/index.html
• Run the tests: cargo test | sed 's/\\n/\n/g; s/: `"/: `"\n/g'
• Delete cargo’s cache, if new code is being ignored: cargo clean
• Try an example: cargo run --example lexemize-rs2018-arg -- "const FOUR: u8 = 4;"