Struct Adam 

pub struct Adam { /* private fields */ }

Adam optimizer.

Implementations

impl Adam

pub fn new( learningrate: f64, beta1: Option<f64>, beta2: Option<f64>, epsilon: Option<f64>, ) -> Self

Create a new Adam optimizer.

Trait Implementations

impl Optimizer for Adam

fn step(&mut self) -> CoreResult<()>

Step the optimizer to update variables.

fn zero_grad(&mut self)

Zero all gradients.

fn add_variable(&mut self, var: Variable)

Add a variable to the optimizer.

fn variables(&self) -> &[Variable]

Get all variables managed by the optimizer.

fn variables_mut(&mut self) -> &mut [Variable]

Get mutable reference to variables (for default implementation)

fn accumulate_gradients(&mut self, gradients: &GradientDict) -> CoreResult<()>

Accumulate gradients for momentum-based optimizers