inference-lab-0.6.1
- inference-lab 0.6.1
- Docs.rs crate page
- MIT
- Links
- Repository
- crates.io
- Source
- Owners
- fergusfinn
- Dependencies
- axum ^0.8 normal optional
  clap ^4.5 normal optional
  colored ^2.1 normal optional
  console_error_panic_hook ^0.1 normal
  env_logger ^0.11 normal optional
  getrandom ^0.2 normal
  js-sys ^0.3 normal
  log ^0.4 normal
  minijinja ^2.0 normal optional
  ordered-float ^4.0 normal
  rand ^0.8 normal
  rand_distr ^0.4 normal
  serde ^1.0 normal
  serde-wasm-bindgen ^0.6 normal
  serde_json ^1.0 normal
  tabled ^0.16 normal optional
  tokenizers ^0.22 normal optional
  tokio ^1 normal optional
  tokio-stream ^0.1 normal optional
  toml ^0.8 normal
  tower-http ^0.6 normal optional
  uuid ^1 normal optional
  wasm-bindgen ^0.2 normal
  tempfile ^3.8 dev
- Versions
- 49.39% of the crate is documented
Go to latest version
Platform
- x86_64-unknown-linux-gnu
Feature flags

docs.rs

Rust

Skip to main content

Files

inference_lab/kv_cache/
mod.rs

1pub mod block;
2pub mod manager;
3
4pub use block::Block;
5pub use manager::KVCacheManager;