Struct SgdOptimizer 

pub struct SgdOptimizer { /* private fields */ }

Vanilla Stochastic Gradient Descent.

Implementations

impl SgdOptimizer

pub fn new(lr: f32) -> Self

Create a new SGD optimizer with the given learning rate.

Trait Implementations

impl Optimizer for SgdOptimizer

fn step( &mut self, weights: &mut Array1<f32>, bias: &mut f32, weight_grad: &Array1<f32>, bias_grad: f32, )

Apply a gradient step.

fn learning_rate(&self) -> f32

Return the current learning rate.

fn set_learning_rate(&mut self, lr: f32)

Override the current learning rate (called by the LR scheduler).