Struct AdaptiveMomentumState 

pub struct AdaptiveMomentumState<B: Backend, const D: usize> {
    pub time: usize,
    pub moment_1: Tensor<B, D>,
    pub moment_2: Tensor<B, D>,
    pub max_moment_2: Option<Tensor<B, D>>,
}

Adaptive momentum state.

Fields

time: usize

The number of iterations aggregated.

moment_1: Tensor<B, D>

The first order momentum.

moment_2: Tensor<B, D>

The second order momentum.

max_moment_2: Option<Tensor<B, D>>

Max of second order momentum (for AMSGrad)

Implementations

impl<B: Backend, const D: usize> AdaptiveMomentumState<B, D>

pub fn new(time: usize, moment_1: Tensor<B, D>, moment_2: Tensor<B, D>) -> Self

Constructs a new AdaptiveMomentumState.

impl<B: Backend, const D: usize> AdaptiveMomentumState<B, D>

pub fn to_device(self, device: &B::Device) -> Self

Move state to device.

Arguments

• device - Device to move state to.

Returns

Returns state moved to device.

Trait Implementations

impl<B: Clone + Backend, const D: usize> Clone for AdaptiveMomentumState<B, D>

fn clone(&self) -> Self

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl<B: Backend, const D: usize> Record<B> for AdaptiveMomentumState<B, D>

type Item<S: PrecisionSettings> = AdaptiveMomentumStateItem<B, D, S>

Type of the item that can be serialized and deserialized.

fn into_item<S: PrecisionSettings>(self) -> Self::Item<S>

Convert the current record into the corresponding item that follows the given settings.

fn from_item<S: PrecisionSettings>( item: Self::Item<S>, device: &B::Device, ) -> Self

Convert the given item into a record.