Expand description
Utility functions for gradient accumulation
Functionsยง
- calculate_
accumulation_ steps - Calculate accumulation steps needed
- calculate_
micro_ batch_ size - Calculate optimal micro-batch size given memory constraints
- validate_
config - Validate gradient accumulation configuration