Skip to main content

layer_norm

Function layer_norm 

Source
pub fn layer_norm(
    x: &[f32],
    d: usize,
    w: &[f32],
    b: Option<&[f32]>,
    eps: f64,
    out: &mut [f32],
)
Expand description

LayerNorm over rows of d: (x - mean) / sqrt(var + eps) * w + b, with the biased variance PyTorch uses.

ยงPanics

If a length does not match.