Crate singe_nvml 

Safe NVIDIA Management Library wrappers for monitoring, device management, MIG, and vGPU APIs.

This crate wraps NVML initialization and shutdown, system queries, device and unit handles, MIG GPU and compute instances, vGPU types and instances, event sets, clocks, power, thermals, memory, utilization, and other management interfaces exposed by NVIDIA drivers.

Setup

NVML is supplied by the NVIDIA driver rather than the CUDA Toolkit. The build and runtime environment must be able to locate the driver NVML library, for example through the platform library path.

Example

use singe_nvml::library::Library;

let nvml = Library::create()?;
let count = nvml.device_count()?;

for index in 0..count {
    let device = nvml.device(index)?;
    let memory = device.memory_info()?;
    println!("{}: {} MiB free", device.name()?, memory.free / 1_048_576);
}

println!("NVML version: {}", singe_nvml::version()?);

Modules

compute_instance

device

error

gpu_instance

library

types

unit

vgpu_instance

vgpu_type

Macros

try_ffi

Functions

version

Returns the version of the NVML library.