Struct SparseMomentumState 

pub struct SparseMomentumState {
    pub momentum: HashMap<usize, f32>,
    pub last_update: HashMap<usize, usize>,
    pub grad_norm_acc: HashMap<usize, f32>,
    pub is_compressed: bool,
}

Sparse momentum state for a parameter.

Fields

momentum: HashMap<usize, f32>

Momentum buffer (only for active indices)

last_update: HashMap<usize, usize>

Last update step for each active index

grad_norm_acc: HashMap<usize, f32>

Accumulated gradient norm (for adaptive methods)

is_compressed: bool

Whether state is compressed

Implementations

impl SparseMomentumState

pub fn new() -> Self

pub fn num_active(&self) -> usize

Get the number of active parameters.

pub fn apply_lazy_update(&mut self, current_step: usize, decay: f32)

Apply lazy momentum updates.

pub fn cleanup(&mut self, max_age_steps: usize, current_step: usize)

Clean up old momentum states.

pub fn compress(&mut self)

Compress inactive momentum states.

pub fn decompress(&mut self)

Decompress momentum states.

Trait Implementations

impl Clone for SparseMomentumState

fn clone(&self) -> SparseMomentumState

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Debug for SparseMomentumState

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl Default for SparseMomentumState

fn default() -> Self

Returns the “default value” for a type.