llama-cpp-2 0.1.154

llama.cpp bindings for Rust
Documentation

llama-cpp-2

There is currently very little information to present on this page because Docs.rs has only limited support for extracting structured feature metadata from Cargo crates. This issue is tracked in Rust RFC #3416. Check this library's main docs, readme, and Cargo.toml in case its authors have documentation for features available there instead.

This version has 20 feature flags, 3 of them enabled by default.

default

android-shared-stdcxx (default)

common (default)

openmp (default)

android-static-stdcxx

cuda

cuda-no-vmm

dynamic-backends

llguidance

metal

mkl

mtmd

opencl

rocm

sampler

This feature flag does not enable additional features.

static-openmp

static-stdcxx

system-ggml

system-ggml-static

vulkan