autotokenizer-0.1.3
- autotokenizer 0.1.3
- Permalink
- Docs.rs crate page
- MIT
- Links
- crates.io
- Source
- Owners
- darkautism
- Dependencies
- hf-hub ^0.4.3 normal
  minijinja ^2.12.0 normal
  serde ^1.0.228 normal
  serde_json ^1.0.145 normal
- Versions
- 0% of the crate is documented
Platform
- x86_64-unknown-linux-gnu
Feature flags

docs.rs

Rust

All

autotokenizer0.1.3

Crate Items

Structs
Enums

List of all items

Structs

AutoTokenizer
DefaultPromptMessage
TokenObj

Enums

Token