llama-cpp-2-0.1.0
- llama-cpp-2 0.1.0
- Docs.rs crate page
- MIT OR Apache-2.0
- Links
- crates.io
- Source
- Owners
- MarcusDunn
- Dependencies
- llama-cpp-sys-2 ^0.1.0 normal
  
  thiserror ^1.0.51 normal
  
  tracing ^0.1.40 normal
  
  criterion ^0.5.1 dev
  
  hf-hub ^0.3.2 dev
  
  pprof ^0.13.0 dev
- Versions
- 100% of the crate is documented
Go to latest version
Platform
- x86_64-unknown-linux-gnu
Feature flags

docs.rs

Rust

llama_cpp_20.1.0

Module kv_cache

In llama_cpp_2::context

Module llama_cpp_2::context::kv_cache

Expand description

utilities for working with the kv cache