Docs.rs
rust_tokenizers-2.0.5
rust_tokenizers 2.0.5
Docs.rs crate page
Apache-2.0
Links
Repository
crates.io
Source
Owners
guillaume-be
Dependencies
csv ^1.1
normal
itertools ^0.8.2
normal
lazy_static ^1.4.0
normal
rayon ^1.2.1
normal
regex ^1.3.1
normal
serde_json ^1.0.44
normal
unicode-normalization ^0.1.8
normal
tempfile ^3.1.0
dev
Versions
Go to latest version
Platform
i686-pc-windows-msvc
i686-unknown-linux-gnu
x86_64-apple-darwin
x86_64-pc-windows-msvc
x86_64-unknown-linux-gnu
Feature flags
Rust
About docs.rs
Privacy policy
Rust website
The Book
Standard Library API Reference
Rust by Example
The Cargo Guide
Clippy Documentation
☰
Module base_vocab
Structs
Traits
Functions
rust_tokenizers
::
preprocessing
::
vocab
All crates
[
−
]
[src]
Module
rust_tokenizers
::
preprocessing
::
vocab
::
base_vocab
Structs
BaseVocab
Traits
Vocab
Functions
swap_key_values