Struct LayerNorm 

pub struct LayerNorm {
    pub config: LayerNormConfig,
}

Layer normalization component

Fields

config: LayerNormConfig

Configuration

Implementations

impl LayerNorm

pub fn new(config: LayerNormConfig) -> Result<Self>

Create a new layer normalization component

pub fn build_layernorm_graph( &self, graph: &mut EinsumGraph, ) -> Result<Vec<usize>>

Build einsum graph for layer normalization

Input tensors:

• 0: x (input) [batch, seq_len, d_model]
• 1: gamma (scale) [d_model] (if elementwise_affine)
• 2: beta (shift) [d_model] (if elementwise_affine)

Output tensors:

• output: [batch, seq_len, d_model] (normalized)

pub fn eps(&self) -> f64

Get epsilon value

pub fn has_elementwise_affine(&self) -> bool

Check if using elementwise affine

Trait Implementations

impl Clone for LayerNorm

fn clone(&self) -> LayerNorm

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Debug for LayerNorm

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.