Skip to main content

layer_norm_raw

Function layer_norm_raw 

Source
pub fn layer_norm_raw(
    data: &[f64],
    gamma: &[f64],
    beta: &[f64],
    out: &mut [f64],
    outer: usize,
    n: usize,
    eps: f64,
)
Expand description

Layer normalization over the last dimension.

For each row of length n: normalize to mean=0, var=1, then scale by gamma and shift by beta.