Struct WeightedGradientsRecord 

pub struct WeightedGradientsRecord {
    pub gradients: GradientsParamsRecord,
    pub state: WeightedAccumulationState,
}

Pending gradients and their actual normalization state, saved together.

Fields

gradients: GradientsParamsRecord

Values keyed by the original model IDs; full precision settings recommended.

state: WeightedAccumulationState

Work dtype, loss scale, effective weight and pending microbatch count.

Trait Implementations

impl Clone for WeightedGradientsRecord

fn clone(&self) -> Self

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Debug for WeightedGradientsRecord

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl<B: Backend> Record<B> for WeightedGradientsRecord

type Item<S: PrecisionSettings> = (GradientsParamsRecord, WeightedAccumulationState)

Type of the item that can be serialized and deserialized.

fn into_item<S: PrecisionSettings>(self) -> Self::Item<S>

Convert the current record into the corresponding item that follows the given settings.

fn from_item<S: PrecisionSettings>( item: Self::Item<S>, device: &B::Device, ) -> Self

Convert the given item into a record.