pub enum LearningRateSchedule {
Constant,
ExponentialDecay {
decay_rate: f64,
},
StepDecay {
decay_factor: f64,
decay_steps: usize,
},
LinearDecay,
CosineAnnealing,
InverseTimeDecay {
decay_rate: f64,
},
}Expand description
Learning rate schedules
Variants§
Constant
Constant learning rate
ExponentialDecay
Exponential decay: lr * decay^epoch
StepDecay
Step decay: lr * decay_factor every decay_steps
LinearDecay
Linear decay: lr * (1 - epoch/max_epochs)
CosineAnnealing
Cosine annealing: lr * 0.5 * (1 + cos(π * epoch/max_epochs))
InverseTimeDecay
Inverse time decay: lr / (1 + decay_rate * epoch)
Trait Implementations§
Source§impl Clone for LearningRateSchedule
impl Clone for LearningRateSchedule
Source§fn clone(&self) -> LearningRateSchedule
fn clone(&self) -> LearningRateSchedule
Returns a duplicate of the value. Read more
1.0.0 · Source§const fn clone_from(&mut self, source: &Self)
const fn clone_from(&mut self, source: &Self)
Performs copy-assignment from
source. Read moreAuto Trait Implementations§
impl Freeze for LearningRateSchedule
impl RefUnwindSafe for LearningRateSchedule
impl Send for LearningRateSchedule
impl Sync for LearningRateSchedule
impl Unpin for LearningRateSchedule
impl UnwindSafe for LearningRateSchedule
Blanket Implementations§
Source§impl<T> BorrowMut<T> for Twhere
T: ?Sized,
impl<T> BorrowMut<T> for Twhere
T: ?Sized,
Source§fn borrow_mut(&mut self) -> &mut T
fn borrow_mut(&mut self) -> &mut T
Mutably borrows from an owned value. Read more
Source§impl<T> CloneToUninit for Twhere
T: Clone,
impl<T> CloneToUninit for Twhere
T: Clone,
Source§impl<T> IntoEither for T
impl<T> IntoEither for T
Source§fn into_either(self, into_left: bool) -> Either<Self, Self>
fn into_either(self, into_left: bool) -> Either<Self, Self>
Converts
self into a Left variant of Either<Self, Self>
if into_left is true.
Converts self into a Right variant of Either<Self, Self>
otherwise. Read moreSource§fn into_either_with<F>(self, into_left: F) -> Either<Self, Self>
fn into_either_with<F>(self, into_left: F) -> Either<Self, Self>
Converts
self into a Left variant of Either<Self, Self>
if into_left(&self) returns true.
Converts self into a Right variant of Either<Self, Self>
otherwise. Read moreSource§impl<T> Pointable for T
impl<T> Pointable for T
Source§impl<SS, SP> SupersetOf<SS> for SPwhere
SS: SubsetOf<SP>,
impl<SS, SP> SupersetOf<SS> for SPwhere
SS: SubsetOf<SP>,
Source§fn to_subset(&self) -> Option<SS>
fn to_subset(&self) -> Option<SS>
The inverse inclusion map: attempts to construct
self from the equivalent element of its
superset. Read moreSource§fn is_in_subset(&self) -> bool
fn is_in_subset(&self) -> bool
Checks if
self is actually part of its subset T (and can be converted to it).Source§fn to_subset_unchecked(&self) -> SS
fn to_subset_unchecked(&self) -> SS
Use with care! Same as
self.to_subset but without any property checks. Always succeeds.Source§fn from_subset(element: &SS) -> SP
fn from_subset(element: &SS) -> SP
The inclusion map: converts
self to the equivalent element of its superset.