Expand description
Actual channel-group normalization and selected first-order derivatives.
Structs§
- Group
Norm Geometry - Actual logical channel-group geometry, shared by backend dispatch and operation graphs.
Functions§
- geometry
- Validate actual
[batch, channels, ...]input and evenly divided nonempty groups. - group_
norm_ backward_ select - Independently requested input/actual-weight/bias derivatives on the same backend.
- group_
norm_ with_ stats - Same-device biased-variance GroupNorm with FP32/FP64 saved
[batch, groups]statistics.