llama-runner 2.3.1

A straightforward Rust library for running llama.cpp models locally on device
Documentation