Struct burn_core::optim::decay::WeightDecay

pub struct WeightDecay<B: Backend> { /* private fields */ }

Weight decay implementation that transforms gradients.

Implementations

impl<B: Backend> WeightDecay<B>

pub fn new(config: &WeightDecayConfig) -> Self

Creates a new weight decay from a config.

pub fn transform<const D: usize>( &self, grad: Tensor<B, D>, tensor: Tensor<B, D> ) -> Tensor<B, D>

Transforms a gradient.

Arguments

• grad - Gradient to transform.
• tensor - Tensor param of the last iteration.

Returns

• grad - Transformed gradient.