Expand description
Gradient checkpointing — snapshot and restore training state.
GradientCheckpoint wraps a ComputationGraphStore with optimizer
metadata so that a training run can be interrupted and resumed without
recomputing the full forward pass from scratch.
Structs§
- Gradient
Checkpoint - A serializable snapshot of the gradient computation state.