bert_tokenizer-0.1.3
Platform
Feature flags

docs.rs

Rust

bert_tokenizer 0.1.3

This crate is a Rust port of Google's BERT WordPiece tokenizer.

Crate
Source
Builds
Feature flags

src
tests
.cargo_vcs_info.json
.gitignore
Cargo.lock
Cargo.toml
Cargo.toml.orig
LICENSE
README.md


/target
**/*.rs.bk
Cargo.lock
.idea