edge-transformers-0.1.2
- edge-transformers 0.1.2
- Permalink
- Docs.rs crate page
- MIT
- Links
- Repository
- crates.io
- Source
- Owners
- eublefar
- Dependencies
- dirs ^4.0.0 normal
  
  futures-util ^0.3.14 normal
  
  half ^2.1 normal
  
  hex ^0.4.3 normal
  
  indicatif ^0.17.2 normal
  
  interoptopus ^0.14.14 normal
  
  itertools ^0.10.5 normal
  
  more-asserts ^0.3.1 normal
  
  ndarray ^0.15 normal
  
  ort ^1.14.1 normal
  
  paste ^1.0.6 normal
  
  rand ^0.8.4 normal
  
  reqwest ^0.11.3 normal
  
  serde ^1.0 normal
  
  serde_json ^1.0 normal
  
  sha2 ^0.10.6 normal
  
  thread_local ^1.1.3 normal
  
  tokenizers ^0.13 normal
  
  tokio ^1.24.1 normal
  
  interoptopus_backend_c ^0.14.14 dev
  
  interoptopus_backend_cpython ^0.14.14 dev
  
  interoptopus_backend_csharp ^0.14.14 dev
- Versions
- 18.58% of the crate is documented
Platform
- x86_64-unknown-linux-gnu
Feature flags

docs.rs

Rust

Module tokenizer

Structs

Module edge_transformers::tokenizer

Structs

AutoTokenizer
A simple tokenizer wrapper that reads special token map for further use in the pipeline.