Struct ZeROConfig 

pub struct ZeROConfig {
    pub stage: ZeROStage,
    pub bucket_size_mb: usize,
    pub overlap_comm: bool,
    pub reduce_bucket_size: usize,
    pub prefetch_depth: usize,
    pub max_memory_usage_mb: usize,
    pub gradient_compression: bool,
    pub pin_memory: bool,
}

Configuration for ZeRO optimizer

Fields

stage: ZeROStage

ZeRO stage to use

bucket_size_mb: usize

Target bucket size for gradient communication (in MB)

overlap_comm: bool

Whether to overlap communication with computation

reduce_bucket_size: usize

Reduce bucket size (number of elements to reduce at once)

prefetch_depth: usize

Prefetch depth for parameter gathering

max_memory_usage_mb: usize

Maximum memory usage threshold before releasing parameters

gradient_compression: bool

Enable gradient compression

pin_memory: bool

Pin memory for faster GPU transfers

Trait Implementations

impl Clone for ZeROConfig

fn clone(&self) -> ZeROConfig

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Debug for ZeROConfig

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl Default for ZeROConfig

fn default() -> Self

Returns the “default value” for a type.