shimmy-llama-cpp-sys-2 0.1.123

Low Level Bindings to llama.cpp with MoE CPU offloading support
Documentation
1
2
#include "llama.cpp/tools/mtmd/mtmd.h"
#include "llama.cpp/tools/mtmd/mtmd-helper.h"