llama_cpp_sys 0.3.2

Automatically-generated bindings to llama.cpp's C API
Documentation

llama_cpp_sys

There is very little structured metadata to build this page from currently. You should check the main library docs, readme, or Cargo.toml in case the author documented the features in them.

This version has 21 feature flags, 8 of them enabled by default.

default

  • compat
  • native

compat

    This feature flag does not enable additional features.

native

  • avx
  • avx2
  • fma
  • f16c
  • accel

avx

    This feature flag does not enable additional features.

avx2

    This feature flag does not enable additional features.

fma

    This feature flag does not enable additional features.

f16c

    This feature flag does not enable additional features.

accel

    This feature flag does not enable additional features.

cuda

  • dep:cudarc

cuda_dmmv

  • cuda

cuda_f16

  • cuda

vulkan

  • dep:ash

cuda_mmq

  • cuda

metal

    This feature flag does not enable additional features.

avx512_vnni

    This feature flag does not enable additional features.

clblast

    This feature flag does not enable additional features.

avx512

    This feature flag does not enable additional features.

mpi

    This feature flag does not enable additional features.

hipblas

    This feature flag does not enable additional features.

blas

    This feature flag does not enable additional features.

avx512_vmbi

    This feature flag does not enable additional features.