infrastructure_llama_bindings 0.0.4

Low Level Bindings to llama.cpp (originally: utilityai/llama-cpp-rs/llama-cpp-sys-2)

infrastructure_llama_bindings

There is currently very little information to present on this page because Docs.rs has only limited support for extracting structured feature metadata from Cargo crates. This issue is tracked in Rust RFC #3416. Check this library's main docs, readme, and Cargo.toml in case its authors have documentation for features available there instead.

This version has 9 feature flags, 0 of them enabled by default.

cuda

This feature flag does not enable additional features.

cuda-no-vmm

This feature flag does not enable additional features.

metal

This feature flag does not enable additional features.

mtmd

This feature flag does not enable additional features.

openmp

This feature flag does not enable additional features.

shared-stdcxx

This feature flag does not enable additional features.

system-ggml

This feature flag does not enable additional features.

vulkan

This feature flag does not enable additional features.