inference-lab-0.6.2
- inference-lab 0.6.2
- Docs.rs crate page
- MIT
- Links
- Repository
- crates.io
- Source
- Owners
- fergusfinn
- Dependencies
- axum ^0.8 normal optional
  clap ^4.5 normal optional
  colored ^2.1 normal optional
  console_error_panic_hook ^0.1 normal
  env_logger ^0.11 normal optional
  getrandom ^0.2 normal
  js-sys ^0.3 normal
  log ^0.4 normal
  minijinja ^2.0 normal optional
  ordered-float ^4.0 normal
  rand ^0.8 normal
  rand_distr ^0.4 normal
  serde ^1.0 normal
  serde-wasm-bindgen ^0.6 normal
  serde_json ^1.0 normal
  tabled ^0.16 normal optional
  tokenizers ^0.22 normal optional
  tokio ^1 normal optional
  tokio-stream ^0.1 normal optional
  toml ^0.8 normal
  tower-http ^0.6 normal optional
  uuid ^1 normal optional
  wasm-bindgen ^0.2 normal
  tempfile ^3.8 dev
- Versions
- 49.39% of the crate is documented
Platform
- x86_64-unknown-linux-gnu
Feature flags

docs.rs

Rust

Skip to main content

Module manager

inference_lab0.6.2

Module manager

Module Items

Structs

In inference_lab::kv_cache

inference_lab::kv_cache

Module manager

Structs§

KVCacheManager: Manages KV cache blocks for all requests