Expand description
Backward pass coordination via TensorSwap.
This module provides the pure-data structures that coordinate distributed backward-pass gradient streaming. No async or network I/O lives here; the transport layer calls these types as CIDs arrive.
Structs§
- Backward
Pass Config - Tuning knobs for a
BackwardPassCoordinator - Backward
Pass Coordinator - Coordinates backward pass gradient streaming via TensorSwap.
- Backward
Pass Stats - Runtime statistics snapshot for a
BackwardPassCoordinator - Backward
Pass Step - Tracks one layer’s backward pass across multiple peers
Enums§
- Aggregation
Method - Aggregation strategy for combining gradients from multiple peers
- Backward
Step Status - Coordination status for a distributed backward pass step
Functions§
- clip_
gradient_ norm - Clip a gradient vector in-place so that its L2 norm does not exceed
max_norm. - federated_
average - Compute the unweighted mean of a collection of gradient vectors.