Skip to main content

adam_step

Function adam_step 

Source
pub fn adam_step(
    embedding: &mut [[f32; 2]],
    grad: &[[f32; 2]],
    state: &mut AdamState,
    t: usize,
    lr: f32,
)
Expand description

Apply one Adam step: update embedding in place.

t is the 1-indexed iteration number (used for bias correction).