llama-crab-sys 0.1.2

Low-level FFI bindings to llama.cpp, ggml, gguf and mtmd (autogenerated via bindgen + cmake)
Documentation
1
2
3
4
5
#include "llama-cparams.h"

size_t llama_max_parallel_sequences(void) {
    return LLAMA_MAX_SEQ;
}