pub fn simd_adam_update(
grad: &[f32],
m: &mut [f32],
v: &mut [f32],
param: &mut [f32],
beta1: f32,
beta2: f32,
lr_t: f32,
epsilon: f32,
)Expand description
Fused Adam parameter update.
Updates momentum, variance, and parameters in a single pass with zero temporary allocations.
ยงArguments
grad- Gradient vectorm- First moment (momentum) vector (updated in-place)v- Second moment (variance) vector (updated in-place)param- Parameter vector (updated in-place)beta1- Momentum decay ratebeta2- Variance decay ratelr_t- Bias-corrected learning rateepsilon- Small constant for numerical stability