Enum MemoryOptimizationStrategy 

pub enum MemoryOptimizationStrategy {
    Basic,
    Standard,
    Aggressive,
    Extreme,
}

Memory optimization strategies for 3D parallelism

Variants

Basic

Basic memory management with minimal optimizations

Standard

Standard memory management with gradient checkpointing

Aggressive

Aggressive memory optimization with activation recomputation

Extreme

Extreme memory optimization with disk offloading

Trait Implementations

impl Clone for MemoryOptimizationStrategy

fn clone(&self) -> MemoryOptimizationStrategy

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Debug for MemoryOptimizationStrategy

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl PartialEq for MemoryOptimizationStrategy

fn eq(&self, other: &MemoryOptimizationStrategy) -> bool

Tests for self and other values to be equal, and is used by ==.

fn ne(&self, other: &Rhs) -> bool

Tests for !=. The default implementation is almost always sufficient, and should not be overridden without very good reason.

impl Copy for MemoryOptimizationStrategy

impl StructuralPartialEq for MemoryOptimizationStrategy