Expand description
GPU memory buffer with pool-aware Drop.
CudaBuffer owns a region of device memory via cudarc::driver::CudaSlice
and tracks its length and originating device ordinal. When dropped, pooled
buffers are returned to the global GPU memory pool for reuse instead of
being freed back to the CUDA driver.
Structsยง
- Cuda
Buffer - Owned GPU memory buffer holding
lenelements of typeT.