llama-cpp-2-0.1.7
- llama-cpp-2 0.1.7
- Docs.rs crate page
- MIT OR Apache-2.0
- Links
- Repository
- crates.io
- Source
- Owners
- MarcusDunn
- Dependencies
- llama-cpp-sys-2 ^0.1.7 normal
  
  thiserror ^1 normal
  
  tracing ^0.1 normal
  
  anyhow ^1.0.79 dev
  
  clap ^4.4.16 dev
  
  criterion ^0.5.1 dev
  
  hf-hub ^0.3.2 dev
  
  pprof ^0.13.0 dev
- Versions
- 100% of the crate is documented
Go to latest version
Platform
- x86_64-unknown-linux-gnu
Feature flags

docs.rs

Rust

llama_cpp_20.1.7

Module params

Structs

In llama_cpp_2::model

Module llama_cpp_2::model::params

Expand description

A safe wrapper around llama_model_params.

Structs

LlamaModelParams
A safe wrapper around llama_model_params.