llama-runner 1.1.0

A straightforward Rust library for running llama.cpp models locally on device
Documentation