Struct LayerNormalizationLayerParams 

pub struct LayerNormalizationLayerParams {
    pub normalized_shape: Vec<i64>,
    pub eps: f32,
    pub gamma: Option<WeightParams>,
    pub beta: Option<WeightParams>,
}

A layer that applies layer normalization over the input tensor.

Requires 1 input and produces 1 output.

output = gamma * (input - computed_mean) / (sqrt(computed_variance + eps)) + beta

Parameters normalizedShape: subset of the input shape, along with layer norm is performed, rest of the input shape is treated as the batch dimension. The mean and variance are computed for the input, over the last few dimensions as specified by the normalizedShape parameter. gamma: must have shape = “normalizedShape” beta: must have shape = “normalizedShape” eps: small constant to avoid division by 0

Output shape is same as the input.

e.g.: input shape = (10,5) normalized shape = (5,) or (10,5)

input shape = (10,5,6,7) normalized shape = (7,) or (6,7) or (5,6,7) or (10,5,6,7)

Fields

normalized_shape: Vec<i64>

eps: f32

gamma: Option<WeightParams>

beta: Option<WeightParams>

Trait Implementations

impl Clone for LayerNormalizationLayerParams

fn clone(&self) -> LayerNormalizationLayerParams

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Debug for LayerNormalizationLayerParams

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl Default for LayerNormalizationLayerParams

fn default() -> Self

Returns the “default value” for a type.

impl Message for LayerNormalizationLayerParams

fn encoded_len(&self) -> usize

Returns the encoded length of the message without a length delimiter.

fn clear(&mut self)

Clears the message, resetting all fields to their default.

fn encode(&self, buf: &mut impl BufMut) -> Result<(), EncodeError>

where Self: Sized,

Encodes the message to a buffer.

fn encode_to_vec(&self) -> Vec<u8>

where Self: Sized,

Encodes the message to a newly allocated buffer.

fn encode_length_delimited( &self, buf: &mut impl BufMut, ) -> Result<(), EncodeError>

where Self: Sized,

Encodes the message with a length-delimiter to a buffer.

fn encode_length_delimited_to_vec(&self) -> Vec<u8>

where Self: Sized,

Encodes the message with a length-delimiter to a newly allocated buffer.

fn decode(buf: impl Buf) -> Result<Self, DecodeError>

where Self: Default,

Decodes an instance of the message from a buffer.

fn decode_length_delimited(buf: impl Buf) -> Result<Self, DecodeError>

where Self: Default,

Decodes a length-delimited instance of the message from the buffer.

fn merge(&mut self, buf: impl Buf) -> Result<(), DecodeError>

where Self: Sized,

Decodes an instance of the message from a buffer, and merges it into self.

fn merge_length_delimited(&mut self, buf: impl Buf) -> Result<(), DecodeError>

where Self: Sized,

Decodes a length-delimited instance of the message from buffer, and merges it into self.

impl PartialEq for LayerNormalizationLayerParams

fn eq(&self, other: &LayerNormalizationLayerParams) -> bool

Tests for self and other values to be equal, and is used by ==.

fn ne(&self, other: &Rhs) -> bool

Tests for !=. The default implementation is almost always sufficient, and should not be overridden without very good reason.

impl StructuralPartialEq for LayerNormalizationLayerParams