mtc-inc-bpe 0.9.0

Incremental BPE tokenization for all prefixes

Coverage
2.17%
1 out of 46 items documented0 out of 0 items with examples
Size
Source code size: 212.92 kB This is the summed size of all the files inside the crates.io package for this release.
Documentation size: 2.46 MB This is the summed size of all files generated by rustdoc for all configured targets
Ø build duration
this release: 38s Average build duration of successful builds.
all releases: 38s Average build duration of successful builds in releases after 2024-10-23.
Links
Homepage
ModelTC/mtc-inc-bpe
0 0 0
crates.io
Dependencies
Versions
- 0.9.0 (2026-05-07)
Owners

mtc-inc-bpe

Incremental BPE tokenization for all prefixes.

License

© 2025 Chielo Newctle <ChieloNewctle@gmail.com>
© 2025 ModelTC Team

This project is licensed under either of

at your option.

The SPDX license identifier for this project is MIT OR Apache-2.0.