pub enum LearningRateScaling<T: FloatBounds> {
Linear,
SquareRoot,
Custom(T),
None,
}Expand description
Learning rate scaling strategies for distributed training
Variants§
Linear
Linear scaling (lr * num_workers)
SquareRoot
Square root scaling (lr * sqrt(num_workers))
Custom(T)
Custom scaling factor
None
No scaling
Trait Implementations§
Source§impl<T: Clone + FloatBounds> Clone for LearningRateScaling<T>
impl<T: Clone + FloatBounds> Clone for LearningRateScaling<T>
Source§fn clone(&self) -> LearningRateScaling<T>
fn clone(&self) -> LearningRateScaling<T>
Returns a duplicate of the value. Read more
1.0.0 (const: unstable) · Source§fn clone_from(&mut self, source: &Self)
fn clone_from(&mut self, source: &Self)
Performs copy-assignment from
source. Read moreAuto Trait Implementations§
impl<T> Freeze for LearningRateScaling<T>where
T: Freeze,
impl<T> RefUnwindSafe for LearningRateScaling<T>where
T: RefUnwindSafe,
impl<T> Send for LearningRateScaling<T>
impl<T> Sync for LearningRateScaling<T>
impl<T> Unpin for LearningRateScaling<T>where
T: Unpin,
impl<T> UnsafeUnpin for LearningRateScaling<T>where
T: UnsafeUnpin,
impl<T> UnwindSafe for LearningRateScaling<T>where
T: UnwindSafe,
Blanket Implementations§
Source§impl<T> BorrowMut<T> for Twhere
T: ?Sized,
impl<T> BorrowMut<T> for Twhere
T: ?Sized,
Source§fn borrow_mut(&mut self) -> &mut T
fn borrow_mut(&mut self) -> &mut T
Mutably borrows from an owned value. Read more
impl<ST, DT> CastableFrom<ST, Initialized, Initialized> for DT
impl<ST, DT> CastableFrom<ST, Uninit, Uninit> for DT
Source§impl<T> CloneToUninit for Twhere
T: Clone,
impl<T> CloneToUninit for Twhere
T: Clone,
Source§impl<T> IntoEither for T
impl<T> IntoEither for T
Source§fn into_either(self, into_left: bool) -> Either<Self, Self>
fn into_either(self, into_left: bool) -> Either<Self, Self>
Converts
self into a Left variant of Either<Self, Self>
if into_left is true.
Converts self into a Right variant of Either<Self, Self>
otherwise. Read moreSource§fn into_either_with<F>(self, into_left: F) -> Either<Self, Self>
fn into_either_with<F>(self, into_left: F) -> Either<Self, Self>
Converts
self into a Left variant of Either<Self, Self>
if into_left(&self) returns true.
Converts self into a Right variant of Either<Self, Self>
otherwise. Read more