llmtop 0.1.0

Realtime TUI monitor for local LLM servers (ollama, llama.cpp). The only GPU monitor that knows what model is running and how much each token costs you in energy and dollar-equivalent.
1
2
3
4

/// Convert energy (Wh) to grams of CO2-equivalent given grid intensity gCO2/kWh.
pub fn wh_to_g_co2(wh: f64, grid_g_per_kwh: f64) -> f64 {
    (wh / 1000.0) * grid_g_per_kwh
}