llama-crab 0.1.7

Safe, ergonomic and complete Rust bindings for llama.cpp
Documentation

llama-crab

There is currently very little information to present on this page because Docs.rs has only limited support for extracting structured feature metadata from Cargo crates. This issue is tracked in Rust RFC #3416. Check this library's main docs, readme, and Cargo.toml in case its authors have documentation for features available there instead.

This version has 19 feature flags, 2 of them enabled by default.

default

metal (default)

openmp (default)

common

cuda

cuda-no-vmm

disk-cache

dynamic-backends

hf-hub

hf-tokenizer

kleidiai

llguidance

mtmd

opencl

rocm

shared-stdcxx

static-stdcxx

system-ggml

vulkan