Expand description
Gradient clipping strategies for distributed tensor learning.
Provides norm clipping and value clipping to prevent gradient explosion during distributed tensor training.
Structs§
- Clipper
Stats - Cumulative statistics for a
TensorGradientClipper. - Clipping
Result - The result of a clipping operation on a single tensor.
- Gradient
Tensor - A single gradient tensor identified by a unique id.
- Tensor
Gradient Clipper - Applies gradient-clipping strategies to collections of
GradientTensors.
Enums§
- Clipping
Strategy - Strategy for clipping gradients.