pub enum LearningRateSchedule {
Constant(f64),
ExponentialDecay {
initial_lr: f64,
decay_rate: f64,
decay_steps: usize,
},
CosineAnnealing {
initial_lr: f64,
min_lr: f64,
cycle_length: usize,
},
StepDecay {
initial_lr: f64,
drop_rate: f64,
epochs_drop: usize,
},
Adaptive {
initial_lr: f64,
patience: usize,
factor: f64,
},
}Expand description
Learning rate scheduling strategies
Variants§
Constant(f64)
Constant learning rate
ExponentialDecay
Exponential decay
CosineAnnealing
Cosine annealing
StepDecay
Step decay
Adaptive
Adaptive learning rate
Trait Implementations§
Source§impl Clone for LearningRateSchedule
impl Clone for LearningRateSchedule
Source§fn clone(&self) -> LearningRateSchedule
fn clone(&self) -> LearningRateSchedule
Returns a duplicate of the value. Read more
1.0.0 · Source§fn clone_from(&mut self, source: &Self)
fn clone_from(&mut self, source: &Self)
Performs copy-assignment from
source. Read moreAuto Trait Implementations§
impl Freeze for LearningRateSchedule
impl RefUnwindSafe for LearningRateSchedule
impl Send for LearningRateSchedule
impl Sync for LearningRateSchedule
impl Unpin for LearningRateSchedule
impl UnwindSafe for LearningRateSchedule
Blanket Implementations§
Source§impl<T> BorrowMut<T> for Twhere
T: ?Sized,
impl<T> BorrowMut<T> for Twhere
T: ?Sized,
Source§fn borrow_mut(&mut self) -> &mut T
fn borrow_mut(&mut self) -> &mut T
Mutably borrows from an owned value. Read more
Source§impl<T> CloneToUninit for Twhere
T: Clone,
impl<T> CloneToUninit for Twhere
T: Clone,
Source§impl<T> IntoEither for T
impl<T> IntoEither for T
Source§fn into_either(self, into_left: bool) -> Either<Self, Self>
fn into_either(self, into_left: bool) -> Either<Self, Self>
Converts
self into a Left variant of Either<Self, Self>
if into_left is true.
Converts self into a Right variant of Either<Self, Self>
otherwise. Read moreSource§fn into_either_with<F>(self, into_left: F) -> Either<Self, Self>
fn into_either_with<F>(self, into_left: F) -> Either<Self, Self>
Converts
self into a Left variant of Either<Self, Self>
if into_left(&self) returns true.
Converts self into a Right variant of Either<Self, Self>
otherwise. Read more