Module gpu_memory_pool

Module gpu_memory_pool 

Source
Expand description

GPU memory pooling for efficient allocation and reuse.

This module provides memory pooling functionality to reduce allocation overhead in GPU computations, particularly for iterative algorithms.

Structsยง

AllocationStats
Allocation statistics
GpuContext
GpuMemory
GpuMemoryPool
GPU memory pool for efficient allocation
MultiDeviceMemoryPool
Memory pool manager for multiple devices
ScopedGpuMemory
Scoped memory allocation that automatically returns to pool