Expand description
Memory-efficient processing for neural networks
This module provides memory optimization strategies including chunked processing, memory pool management, and optimization capability detection for large-scale neural network operations that exceed available memory.
Structsยง
- Memory
Efficient Processor - Memory efficient processor for handling large models (no-op implementation when feature disabled)
- Memory
Monitor - Memory usage monitor for tracking neural network memory consumption
- Memory
Pool - Memory pool for efficient tensor allocation and reuse
- Memory
Pool Stats - Memory pool statistics
- Memory
Settings - Memory settings configuration
- Memory
Stats - Memory usage statistics
- Optimization
Capabilities - Information about available optimization capabilities
- SIMD
Stats - SIMD operation statistics and capabilities