alith-models-0.4.3
- alith-models 0.4.3
- Permalink
- Docs.rs crate page
- Apache-2.0
- Links
- Homepage
- Repository
- crates.io
- Source
- Owners
- nora-coder-dot
- Dependencies
- alith-prompt ^0.4.3 normal
  anyhow ^1.0.97 normal
  byteorder ^1.5.0 normal
  colorful ^0.3.2 normal
  dotenvy ^0.15.7 normal
  half ^2.5.0 normal
  hf-hub ^0.4.2 normal
  indenter ^0.3.3 normal
  minijinja ^2.8.0 normal
  paste ^1.0.15 normal
  serde ^1.0.219 normal
  serde_json ^1.0.140 normal
  thiserror ^2.0.12 normal
  tiktoken-rs ^0.6.0 normal
  tokenizers ^0.21.1 normal
  tracing ^0.1.40 normal
- Versions
- 6.65% of the crate is documented
Platform
- x86_64-unknown-linux-gnu
Feature flags

docs.rs

Rust

Skip to main content

Module tokenizer

alith_models0.4.3

Module tokenizer

Module Items

Structs
Enums

In crate alith_models

Module tokenizer

Structs§

Tokenizer

Enums§

TokenizerBackend