Enum Optimizer 

pub enum Optimizer {
    Sgd,
    SgdMomentum {
        momentum: f32,
    },
    Adam {
        beta1: f32,
        beta2: f32,
        eps: f32,
    },
}

Optimizer choice for training.

Variants

Sgd

Plain SGD.

SgdMomentum

SGD with momentum.

Fields

momentum: f32

Adam

Adam (bias-corrected).

Fields

beta1: f32

beta2: f32

eps: f32

Implementations

impl Optimizer

pub fn validate(self) -> Result<()>

Validate optimizer hyperparameters.

pub fn state(self, model: &Mlp) -> Result<OptimizerState>

Allocate optimizer state for model.

Trait Implementations

impl Clone for Optimizer

fn clone(&self) -> Optimizer

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Debug for Optimizer

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl Default for Optimizer

fn default() -> Optimizer

Returns the “default value” for a type.

impl PartialEq for Optimizer

fn eq(&self, other: &Optimizer) -> bool

Tests for self and other values to be equal, and is used by ==.

fn ne(&self, other: &Rhs) -> bool

Tests for !=. The default implementation is almost always sufficient, and should not be overridden without very good reason.

impl Copy for Optimizer

impl StructuralPartialEq for Optimizer