pub enum GradSyncStrategy {
Synchronous,
Overlapped,
NoSync,
}Expand description
Strategy for gradient synchronization.
Variants§
Synchronous
Synchronize after each backward pass.
Overlapped
Overlap computation and communication.
NoSync
No gradient synchronization (for debugging).
Trait Implementations§
Source§impl Clone for GradSyncStrategy
impl Clone for GradSyncStrategy
Source§fn clone(&self) -> GradSyncStrategy
fn clone(&self) -> GradSyncStrategy
Returns a duplicate of the value. Read more
1.0.0 · Source§fn clone_from(&mut self, source: &Self)
fn clone_from(&mut self, source: &Self)
Performs copy-assignment from
source. Read moreSource§impl Debug for GradSyncStrategy
impl Debug for GradSyncStrategy
Source§impl PartialEq for GradSyncStrategy
impl PartialEq for GradSyncStrategy
impl Copy for GradSyncStrategy
impl Eq for GradSyncStrategy
impl StructuralPartialEq for GradSyncStrategy
Auto Trait Implementations§
impl Freeze for GradSyncStrategy
impl RefUnwindSafe for GradSyncStrategy
impl Send for GradSyncStrategy
impl Sync for GradSyncStrategy
impl Unpin for GradSyncStrategy
impl UnwindSafe for GradSyncStrategy
Blanket Implementations§
Source§impl<T> BorrowMut<T> for Twhere
T: ?Sized,
impl<T> BorrowMut<T> for Twhere
T: ?Sized,
Source§fn borrow_mut(&mut self) -> &mut T
fn borrow_mut(&mut self) -> &mut T
Mutably borrows from an owned value. Read more
Source§impl<T> CloneToUninit for Twhere
T: Clone,
impl<T> CloneToUninit for Twhere
T: Clone,
Source§impl<T> IntoEither for T
impl<T> IntoEither for T
Source§fn into_either(self, into_left: bool) -> Either<Self, Self>
fn into_either(self, into_left: bool) -> Either<Self, Self>
Converts
self into a Left variant of Either<Self, Self>
if into_left is true.
Converts self into a Right variant of Either<Self, Self>
otherwise. Read moreSource§fn into_either_with<F>(self, into_left: F) -> Either<Self, Self>
fn into_either_with<F>(self, into_left: F) -> Either<Self, Self>
Converts
self into a Left variant of Either<Self, Self>
if into_left(&self) returns true.
Converts self into a Right variant of Either<Self, Self>
otherwise. Read more