llama_cpp
There is currently very little information to present on
this page because Docs.rs has only limited support for
extracting structured feature metadata from Cargo crates.
This issue is tracked in
Rust RFC #3416.
Check this library's
main docs,
readme, and
Cargo.toml
in case its authors have documentation for features
available there instead.
This version has 21 feature flags, 7 of them enabled by default.
default
compat (default)
native (default)
accel (default)
avx (default)
avx2 (default)
f16c (default)
fma (default)
avx512
avx512_vmbi
avx512_vnni
blas
clblast
cuda
cuda_dmmv
cuda_f16
cuda_mmq
hipblas
metal
mpi
sys_verbosity
This feature flag does not enable additional features.