llama-runner 2.3.2

A straightforward Rust library for running llama.cpp models locally on device
Documentation