llama_cpp_sys 0.3.2

Automatically-generated bindings to llama.cpp's C API

llama_cpp_sys

There is very little structured metadata to build this page from currently. You should check the main library docs, readme, or Cargo.toml in case the author documented the features in them.

This version has 20 feature flags, 7 of them enabled by default.

default

compat (default)

This feature flag does not enable additional features.

native (default)

accel (default)

This feature flag does not enable additional features.

avx (default)

This feature flag does not enable additional features.

avx2 (default)

This feature flag does not enable additional features.

f16c (default)

This feature flag does not enable additional features.

fma (default)

This feature flag does not enable additional features.

avx512

This feature flag does not enable additional features.

avx512_vmbi

This feature flag does not enable additional features.

avx512_vnni

This feature flag does not enable additional features.

blas

This feature flag does not enable additional features.

clblast

This feature flag does not enable additional features.

cuda

cuda_dmmv

cuda_f16

cuda_mmq

hipblas

This feature flag does not enable additional features.

metal

This feature flag does not enable additional features.

mpi

This feature flag does not enable additional features.

vulkan