pub fn device_memory_info() -> Option<(usize, usize)>Expand description
Return (free, total) device-memory bytes for the selected
device, or None when we’re not on CUDA.
Thin wrapper around cuMemGetInfo via cudarc; exposed so the
PLAID builder can annotate its progress output with the headroom
the CUDA mempool has left before a big allocation.