Struct FileGradSyncConfig 

pub struct FileGradSyncConfig {
    pub world_size: usize,
    pub rank: usize,
    pub sync_dir: PathBuf,
    pub max_wait: Duration,
}

Settings for averaging gradients across processes through files in a shared directory (a prototype for multi-process data parallelism).

Fields

world_size: usize

Number of processes.

rank: usize

This process’s index in 0..world_size.

sync_dir: PathBuf

Directory every rank can read and write.

max_wait: Duration

How long to wait for the other ranks before failing a step.

Implementations

impl FileGradSyncConfig

pub fn new( world_size: usize, rank: usize, sync_dir: impl Into<PathBuf>, ) -> Result<Self, String>

Validate rank < world_size and build a config (10-minute wait).

pub fn with_max_wait(self, max_wait: Duration) -> Self

Override how long to wait for other ranks.

pub fn is_root(&self) -> bool

Whether this is rank 0 (which averages and writes results).

pub fn enabled(&self) -> bool

Whether there is more than one process.

Trait Implementations

impl Clone for FileGradSyncConfig

fn clone(&self) -> Self

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Debug for FileGradSyncConfig

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.