Enum GradientAccumulationStrategy 

pub enum GradientAccumulationStrategy {
    Standard,
    Average,
    Checkpointing,
    MixedPrecision,
}

Strategy for accumulating gradients

Variants

Standard

Standard accumulation (sum gradients)

Average

Average gradients over accumulation steps

Checkpointing

Gradient checkpointing to save memory

MixedPrecision

Mixed precision accumulation

Trait Implementations

impl Clone for GradientAccumulationStrategy

fn clone(&self) -> GradientAccumulationStrategy

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Debug for GradientAccumulationStrategy

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl PartialEq for GradientAccumulationStrategy

fn eq(&self, other: &GradientAccumulationStrategy) -> bool

Tests for self and other values to be equal, and is used by ==.

fn ne(&self, other: &Rhs) -> bool

Tests for !=. The default implementation is almost always sufficient, and should not be overridden without very good reason.

impl Copy for GradientAccumulationStrategy

impl Eq for GradientAccumulationStrategy

impl StructuralPartialEq for GradientAccumulationStrategy