hermes-core-1.3.3
- hermes-core 1.3.3
- Docs.rs crate page
- MIT
- Links
- Homepage
- Repository
- crates.io
- Source
- Owners
- ppodolsky
- Dependencies
- async-trait ^0.1 normal
  base64 ^0.22 normal
  bincode ^2.0 normal optional
  bumpalo ^3.19 normal optional
  byteorder ^1.5 normal
  crossbeam-channel ^0.5 normal optional
  futures ^0.3 normal
  half ^2.7 normal
  hashbrown ^0.15 normal
  instant ^0.1 normal optional
  kmeans ^2.0 normal optional
  lasso ^0.7 normal optional
  log ^0.4 normal
  memmap2 ^0.9 normal optional
  nalgebra ^0.34 normal optional
  num_cpus ^1.17 normal optional
  parking_lot ^0.12 normal
  pest ^2.8 normal
  pest_derive ^2.8 normal
  rand ^0.9 normal
  rayon ^1.11 normal optional
  regex ^1.12 normal
  reqwest ^0.13 normal optional
  rust-stemmers ^1.2 normal
  rustc-hash ^2.1 normal
  serde ^1.0 normal
  serde_json ^1.0 normal
  smallvec ^1.15 normal
  stop-words ^0.8 normal
  thiserror ^2.0 normal
  tokio ^1.49 normal optional
  uuid ^1.19 normal optional
  zstd ^0.13 normal
  comfy-table ^7 dev
  criterion ^0.5 dev
  rand ^0.9 dev
  tempfile ^3.24 dev
  tokio ^1.49 dev
  reqwest ^0.13 normal optional
  tokenizers ^0.22 normal optional
  tokio ^1.49 normal
  reqwest ^0.13 normal optional
  tokenizers ^0.22 normal optional
- Versions
- 76.46% of the crate is documented
Go to latest version
Platform
- x86_64-unknown-linux-gnu
Feature flags

docs.rs

Rust

Skip to main content

tokenizer_cache

hermes_core1.3.3

In hermes_core::tokenizer

hermes_core::tokenizer

Function tokenizer_cache

pub fn tokenizer_cache() -> &'static TokenizerCache

Expand description

Get the global tokenizer cache