Module dfdx::optim

source · [−]
Expand description

Optimizers such as Sgd and Adam that can optimize neural networks.

Structs

Adam

An implementation of the Adam optimizer from Adam: A Method for Stochastic Optimization

Sgd

Implementation of Stochastic Gradient Descent. Based on pytorch’s implementation

Enums

Momentum

Traits

Optimizer

All optimizers must implement the update function, which takes an object that implements CanUpdateWithGradients, and calls CanUpdateWithGradients::update.