Skip to main content

rms_norm_gemma

Function rms_norm_gemma 

Source
pub fn rms_norm_gemma(
    x: &[f32],
    weight: &[f32],
    eps: f32,
) -> Result<Vec<f32>, EngineError>
Expand description

Gemma-style RMSNorm: x * rrms * (1 + weight).