pub struct DistributedTrainingConfig {
pub strategy: DistributedStrategy,
pub numworkers: usize,
pub rank: usize,
pub is_master: bool,
pub syncinterval: usize,
pub backend: String,
pub mixed_precision: bool,
pub gradient_accumulation_steps: usize,
}Expand description
Configuration for distributed training.
Fields§
§strategy: DistributedStrategyDistributed training strategy.
numworkers: usizeNumber of workers.
rank: usizeRank of the current worker.
is_master: boolWhether this worker is the master.
syncinterval: usizeSynchronization interval (in batches).
backend: StringCommunication backend.
mixed_precision: boolWhether to use mixed precision training.
gradient_accumulation_steps: usizeGradient accumulation steps.
Trait Implementations§
Source§impl Clone for DistributedTrainingConfig
impl Clone for DistributedTrainingConfig
Source§fn clone(&self) -> DistributedTrainingConfig
fn clone(&self) -> DistributedTrainingConfig
Returns a duplicate of the value. Read more
1.0.0 · Source§fn clone_from(&mut self, source: &Self)
fn clone_from(&mut self, source: &Self)
Performs copy-assignment from
source. Read moreSource§impl Debug for DistributedTrainingConfig
impl Debug for DistributedTrainingConfig
Auto Trait Implementations§
impl Freeze for DistributedTrainingConfig
impl RefUnwindSafe for DistributedTrainingConfig
impl Send for DistributedTrainingConfig
impl Sync for DistributedTrainingConfig
impl Unpin for DistributedTrainingConfig
impl UnwindSafe for DistributedTrainingConfig
Blanket Implementations§
Source§impl<T> BorrowMut<T> for Twhere
T: ?Sized,
impl<T> BorrowMut<T> for Twhere
T: ?Sized,
Source§fn borrow_mut(&mut self) -> &mut T
fn borrow_mut(&mut self) -> &mut T
Mutably borrows from an owned value. Read more
Source§impl<T> CloneToUninit for Twhere
T: Clone,
impl<T> CloneToUninit for Twhere
T: Clone,
Source§impl<T> IntoEither for T
impl<T> IntoEither for T
Source§fn into_either(self, into_left: bool) -> Either<Self, Self>
fn into_either(self, into_left: bool) -> Either<Self, Self>
Converts
self into a Left variant of Either<Self, Self>
if into_left is true.
Converts self into a Right variant of Either<Self, Self>
otherwise. Read moreSource§fn into_either_with<F>(self, into_left: F) -> Either<Self, Self>
fn into_either_with<F>(self, into_left: F) -> Either<Self, Self>
Converts
self into a Left variant of Either<Self, Self>
if into_left(&self) returns true.
Converts self into a Right variant of Either<Self, Self>
otherwise. Read more