Module momentum 

SGD with Momentum optimizer

This module implements Stochastic Gradient Descent with momentum, including both classical momentum and Nesterov accelerated gradient (NAG) variants.

Structs

MomentumOptions

Options for SGD with momentum optimization

Functions

minimize_adaptive_momentum

Adaptive momentum based on gradient correlation

minimize_heavy_ball

Heavy-ball momentum (Polyak momentum) implementation

minimize_sgd_momentum

SGD with momentum optimizer implementation