Docs.rs
bert_tokenizer-0.1.3
Platform
i686-pc-windows-msvc
i686-unknown-linux-gnu
x86_64-apple-darwin
x86_64-pc-windows-msvc
x86_64-unknown-linux-gnu
Feature flags
Rust
About docs.rs
Privacy policy
Rust website
The Book
Standard Library API Reference
Rust by Example
The Cargo Guide
Clippy Documentation
bert_tokenizer 0.1.3
This crate is a Rust port of Google's BERT WordPiece tokenizer.
Crate
Source
Builds
Feature flags
Documentation
src
tests
.cargo_vcs_info.json
.gitignore
Cargo.lock
Cargo.toml
Cargo.toml.orig
LICENSE
README.md