Docs.rs
dataflow_nlp-0.1.1
dataflow_nlp 0.1.1
Permalink
Docs.rs crate page
MIT
OR
Apache-2.0
Links
crates.io
Source
Owners
jafioti
Dependencies
dataflow ^0.4
normal
lentrait ^0.2
normal
rand ^0.8
normal
regex ^1.5
normal
serde ^1.0
normal
serde_json ^1.0
normal
tokenizers ^0.11
normal
Versions
54.55%
of the crate is documented
Platform
x86_64-unknown-linux-gnu
Feature flags
docs.rs
About docs.rs
Privacy policy
Rust
Rust website
The Book
Standard Library API Reference
Rust by Example
The Cargo Guide
Clippy Documentation
dataflow_
nlp
0.1.1
All Items
Crate Items
Modules
Crate
dataflow_nlp
Copy item path
Source
Modules
ยง
batching
Uilities for dealing with batches, such as shuffling and sorting batches
pipelines
Dataflow pipeline nodes
tokenization
All tokenization and untokenization
vocab
Vocab object and the functions to load different vocabularies