sentencepiece-rust 0.1.1

From-scratch pure-Rust SentencePiece inference (encode/decode), differentially verified against the upstream C++/Python implementation.

1
2
3

* text=auto eol=lf
*.model binary
*.tsv text eol=lf