ik-llama-cpp-sys 0.1.2

Low level bindings to ik_llama.cpp (ikawrakow's SOTA-quant fork)

Coverage
1.62%
29 out of 1792 items documented0 out of 56 items with examples
Size
Source code size: 21.35 MB This is the summed size of all the files inside the crates.io package for this release.
Documentation size: 11.36 MB This is the summed size of all files generated by rustdoc for all configured targets
Ø build duration
this release: 17s Average build duration of successful builds.
all releases: 16s Average build duration of successful builds in releases after 2024-10-23.
Links
replikeit/ik-llama-cpp-rs
1 0 0
crates.io
Dependencies
Versions
Owners

ik-llama-cpp-sys

Low-level FFI bindings to ik_llama.cpp (ikawrakow's SOTA-quantization fork of llama.cpp), generated with bindgen. links = "ik_llama".

You almost certainly want the safe wrapper ik-llama-cpp-2 instead of this crate directly.

The ik_llama.cpp source is vendored, so cargo add ik-llama-cpp-sys needs no submodule step — but the build compiles it from source, so CMake, a C/C++ toolchain, and libclang (for bindgen) are required. A prebuilt library can be linked instead via IK_LLAMA_CPP_LIB_DIR (+ IK_LLAMA_CPP_SRC for headers).

Features: cuda, vulkan, openmp, native, common (ik common/ + the MTP/json-schema glue), mtmd (libmtmd). Default = CPU core.

License

Licensed under either of Apache-2.0 or MIT at your option. Bundles ik_llama.cpp (MIT).