Module rmsprop

Module rmsprop 

Source
Expand description

RMSProp (Root Mean Square Propagation) optimizer

RMSProp is an adaptive learning rate method that addresses AdaGrad’s learning rate decay problem. It maintains a moving average of the squared gradients and divides the gradient by the root of this average.

Structs§

RMSPropOptions
Options for RMSProp optimization

Functions§

minimize_graves_rmsprop
Graves’ RMSProp implementation with improved numerical stability
minimize_rmsprop
RMSProp optimizer implementation