Struct ParamState 

pub struct ParamState {
    pub momentum_buffer: Option<Vec<f32>>,
    pub exp_avg_sq: Option<Vec<f32>>,
    pub max_exp_avg_sq: Option<Vec<f32>>,
    pub step: usize,
}

State associated with a parameter during optimization.

Different optimizers store different state (e.g., momentum, variance).

Fields

momentum_buffer: Option<Vec<f32>>

First moment (momentum) - used by SGD with momentum, Adam

exp_avg_sq: Option<Vec<f32>>

Second moment (variance) - used by Adam, RMSprop

max_exp_avg_sq: Option<Vec<f32>>

Max second moment - used by AdaMax

step: usize

Step count for bias correction

Implementations

impl ParamState

pub fn new() -> Self

Creates a new empty parameter state.

pub fn init_momentum(&mut self, size: usize)

Initializes momentum buffer with zeros.

pub fn init_exp_avg_sq(&mut self, size: usize)

Initializes exponential average squared buffer with zeros.

Trait Implementations

impl Clone for ParamState

fn clone(&self) -> ParamState

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Debug for ParamState

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl Default for ParamState

fn default() -> Self

Returns the “default value” for a type.