Struct WeightDecay 

pub struct WeightDecay { /* private fields */ }

Weight decay implementation that transforms gradients.

Implementations

impl WeightDecay

pub fn new(config: &WeightDecayConfig) -> Self

Creates a new weight decay from a config.

pub fn transform<B: Backend, const D: usize>( &self, grad: Tensor<B, D>, tensor: Tensor<B, D>, ) -> Tensor<B, D>

Transforms a gradient.

Arguments

• grad - Gradient to transform.
• tensor - Tensor param of the last iteration.

Returns

• grad - Transformed gradient.

Trait Implementations

impl Clone for WeightDecay

fn clone(&self) -> WeightDecay

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.