Expand description
GPU memory pooling for efficient allocation and reuse.
This module provides memory pooling functionality to reduce allocation overhead in GPU computations, particularly for iterative algorithms.
Structsยง
- Allocation
Stats - Allocation statistics
- GpuContext
- GpuMemory
- GpuMemory
Pool - GPU memory pool for efficient allocation
- Multi
Device Memory Pool - Memory pool manager for multiple devices
- Scoped
GpuMemory - Scoped memory allocation that automatically returns to pool