Struct RmsNorm 

pub struct RmsNorm { /* private fields */ }

Implementations

impl RmsNorm

pub fn new(size: usize, eps: f64, vb: ShardedVarBuilder) -> Result<Self>

pub fn new_gemma(size: usize, eps: f64, vb: ShardedVarBuilder) -> Result<Self>

👎Deprecated:

Use GemmaRmsNorm::new() instead, which handles UQFF serialization correctly

Gemma uses weight + 1.0

pub fn new_gemma_3n( size: usize, eps: f64, with_scale: bool, vb: ShardedVarBuilder, ) -> Result<Self>

Gemma 3n uses weight

pub fn undo_gemma(&self) -> Result<Self>

👎Deprecated:

Use GemmaRmsNorm instead, which handles UQFF serialization automatically

Gemma uses weight + 1.0. Undo for UQFF generation.

pub fn from_w(w: Tensor, eps: f64) -> Result<Self>

pub fn weight(&self) -> &Tensor

pub fn eps(&self) -> f64

pub fn forward_residual(&self, x: &Tensor, residual: &Tensor) -> Result<Tensor>

pub fn forward_residual_scaled( &self, x: &Tensor, residual: &Tensor, scale: &Tensor, ) -> Result<Tensor>

Trait Implementations

impl Clone for RmsNorm

fn clone(&self) -> RmsNorm

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Debug for RmsNorm

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl Module for RmsNorm

fn forward(&self, x: &Tensor) -> Result<Tensor>