Module memory_efficient

Memory-efficient operations module Memory-efficient implementations for neural networks

This module provides memory optimization techniques including:

• Gradient checkpointing for reduced memory usage during training
• In-place operations to minimize memory allocations
• Memory pool management for efficient tensor allocation
• Memory-aware batch processing
• Lazy evaluation and computation graphs

Structs

BatchProcessorStats

Statistics for the batch processor

GradientCheckpointing

Gradient checkpointing implementation for memory-efficient training

InPlaceOperations

In-place operations manager for minimizing memory allocations

MemoryAwareBatchProcessor

Memory-aware batch processor for handling large datasets

MemoryEfficientLayer

Memory-efficient neural network layer that processes data in chunks

MemoryPool

Memory pool for efficient tensor allocation and reuse

MemoryUsage

Memory usage tracking and reporting

PoolStatistics

Statistics about the memory pool