pub struct DistributedConfig {
pub parallelism: ParallelismStrategy,
pub num_devices: usize,
pub backend: String,
pub master_addr: Option<String>,
pub master_port: Option<u16>,
pub rank: usize,
pub world_size: usize,
pub enable_gradient_compression: bool,
pub enable_mixed_precision: bool,
pub bucket_size: usize,
pub enable_async_communication: bool,
}Expand description
Configuration for distributed execution.
Fields§
§parallelism: ParallelismStrategyParallelism strategy to use
num_devices: usizeNumber of devices to use
backend: StringCommunication backend (e.g., “nccl”, “gloo”, “mpi”)
master_addr: Option<String>Master address for multi-node setups
master_port: Option<u16>Master port for multi-node setups
rank: usizeRank of this process (0 to world_size-1)
world_size: usizeTotal number of processes (world size)
enable_gradient_compression: boolEnable gradient compression
enable_mixed_precision: boolEnable mixed precision
bucket_size: usizeBucket size for gradient bucketing (bytes)
enable_async_communication: boolEnable asynchronous communication
Trait Implementations§
Source§impl Clone for DistributedConfig
impl Clone for DistributedConfig
Source§fn clone(&self) -> DistributedConfig
fn clone(&self) -> DistributedConfig
Returns a duplicate of the value. Read more
1.0.0 · Source§fn clone_from(&mut self, source: &Self)
fn clone_from(&mut self, source: &Self)
Performs copy-assignment from
source. Read moreSource§impl Debug for DistributedConfig
impl Debug for DistributedConfig
Auto Trait Implementations§
impl Freeze for DistributedConfig
impl RefUnwindSafe for DistributedConfig
impl Send for DistributedConfig
impl Sync for DistributedConfig
impl Unpin for DistributedConfig
impl UnwindSafe for DistributedConfig
Blanket Implementations§
Source§impl<T> BorrowMut<T> for Twhere
T: ?Sized,
impl<T> BorrowMut<T> for Twhere
T: ?Sized,
Source§fn borrow_mut(&mut self) -> &mut T
fn borrow_mut(&mut self) -> &mut T
Mutably borrows from an owned value. Read more