Docs.rs
bpe-tokenizer-0.1.4
Platform
i686-pc-windows-msvc
i686-unknown-linux-gnu
x86_64-apple-darwin
x86_64-pc-windows-msvc
x86_64-unknown-linux-gnu
Feature flags
docs.rs
About docs.rs
Privacy policy
Rust
Rust website
The Book
Standard Library API Reference
Rust by Example
The Cargo Guide
Clippy Documentation
bpe-tokenizer 0.1.4
A BPE Tokenizer library.
Crate
Source
Builds
Feature flags
Documentation
src
vocab
.build.yml
.cargo_vcs_info.json
.gitignore
build.rs
Cargo.lock
Cargo.toml
Cargo.toml.orig
deny.toml
LICENSE
README.md