pub enum ReductionStrategy {
AllReduce,
ParameterServer,
Hierarchical,
}
Expand description
Gradient reduction strategy for multi-GPU training
Variants§
AllReduce
All-reduce algorithm
ParameterServer
Parameter server algorithm
Hierarchical
Hierarchical reduction algorithm
Trait Implementations§
Source§impl Clone for ReductionStrategy
impl Clone for ReductionStrategy
Source§fn clone(&self) -> ReductionStrategy
fn clone(&self) -> ReductionStrategy
Returns a duplicate of the value. Read more
1.0.0 · Source§const fn clone_from(&mut self, source: &Self)
const fn clone_from(&mut self, source: &Self)
Performs copy-assignment from
source
. Read moreSource§impl Debug for ReductionStrategy
impl Debug for ReductionStrategy
Source§impl<'de> Deserialize<'de> for ReductionStrategy
impl<'de> Deserialize<'de> for ReductionStrategy
Source§fn deserialize<__D>(__deserializer: __D) -> Result<Self, __D::Error>where
__D: Deserializer<'de>,
fn deserialize<__D>(__deserializer: __D) -> Result<Self, __D::Error>where
__D: Deserializer<'de>,
Deserialize this value from the given Serde deserializer. Read more
Source§impl PartialEq for ReductionStrategy
impl PartialEq for ReductionStrategy
Source§impl Serialize for ReductionStrategy
impl Serialize for ReductionStrategy
impl StructuralPartialEq for ReductionStrategy
Auto Trait Implementations§
impl Freeze for ReductionStrategy
impl RefUnwindSafe for ReductionStrategy
impl Send for ReductionStrategy
impl Sync for ReductionStrategy
impl Unpin for ReductionStrategy
impl UnwindSafe for ReductionStrategy
Blanket Implementations§
Source§impl<T> BorrowMut<T> for Twhere
T: ?Sized,
impl<T> BorrowMut<T> for Twhere
T: ?Sized,
Source§fn borrow_mut(&mut self) -> &mut T
fn borrow_mut(&mut self) -> &mut T
Mutably borrows from an owned value. Read more
Source§impl<T> CloneToUninit for Twhere
T: Clone,
impl<T> CloneToUninit for Twhere
T: Clone,
Source§impl<T> IntoEither for T
impl<T> IntoEither for T
Source§fn into_either(self, into_left: bool) -> Either<Self, Self>
fn into_either(self, into_left: bool) -> Either<Self, Self>
Converts
self
into a Left
variant of Either<Self, Self>
if into_left
is true
.
Converts self
into a Right
variant of Either<Self, Self>
otherwise. Read moreSource§fn into_either_with<F>(self, into_left: F) -> Either<Self, Self>
fn into_either_with<F>(self, into_left: F) -> Either<Self, Self>
Converts
self
into a Left
variant of Either<Self, Self>
if into_left(&self)
returns true
.
Converts self
into a Right
variant of Either<Self, Self>
otherwise. Read more