Expand description
GPU memory management utilities
This module provides advanced GPU memory management including:
- Memory pools for efficient allocation/deallocation
- Unified memory management for CUDA
- Multi-GPU memory distribution
- Memory bandwidth optimization
Structs§
- Bandwidth
Config - Memory bandwidth optimization settings
- GpuMemory
Block - GPU memory block descriptor
- GpuMemory
Pool - Memory pool for GPU allocations
- Memory
Stats - Memory usage statistics
- Multi
GpuMemory Manager - Multi-GPU memory manager
- Unified
Memory Buffer - Unified memory buffer for CUDA
Enums§
- Allocation
Strategy - Memory allocation strategy