alith-models-0.4.3
- alith-models 0.4.3
- Docs.rs crate page
- Apache-2.0
- Links
- Homepage
- Repository
- crates.io
- Source
- Owners
- nora-coder-dot
- Dependencies
- alith-prompt ^0.4.3 normal
  
  anyhow ^1.0.97 normal
  
  byteorder ^1.5.0 normal
  
  colorful ^0.3.2 normal
  
  dotenvy ^0.15.7 normal
  
  half ^2.5.0 normal
  
  hf-hub ^0.4.2 normal
  
  indenter ^0.3.3 normal
  
  minijinja ^2.8.0 normal
  
  paste ^1.0.15 normal
  
  serde ^1.0.219 normal
  
  serde_json ^1.0.140 normal
  
  thiserror ^2.0.12 normal
  
  tiktoken-rs ^0.6.0 normal
  
  tokenizers ^0.21.1 normal
  
  tracing ^0.1.40 normal
- Versions
- 6.65% of the crate is documented
Platform
- x86_64-unknown-linux-gnu
Feature flags

docs.rs

Rust

model_tokenizer

alith_models0.4.3

In alith_models::api_model::perplexity

alith_models::api_model::perplexity

Function model_tokenizer

pub fn model_tokenizer(_model_id: &str) -> Arc<Tokenizer>