llama-runner 1.1.2

A straightforward Rust library for running llama.cpp models locally on device
Documentation