Expand description
Core gradient tensor types and operations.
This module provides the fundamental gradient data structures:
SparseGradient— sparse representation with index/value pairsQuantizedGradient— int8-quantized representation for compressionLayerGradient— enum over dense / sparse / quantizedGradientDelta— per-layer gradient bundle linked to a base model CIDGradientCompressor— top-k, threshold, random, and quantization compressionGradientAggregator— average, weighted-average, and momentum helpersGradientVerifier— shape, finiteness, outlier, clipping utilities
Structs§
- Gradient
Aggregator - Gradient aggregation for federated learning
- Gradient
Compressor - Gradient compression utilities
- Gradient
Delta - Gradient delta (difference from base model)
- Gradient
Verifier - Gradient verification utilities
- Quantized
Gradient - Quantized gradient (reduced precision)
- Sparse
Gradient - Sparse gradient representation
Enums§
- Layer
Gradient - Gradient for a single layer