pub struct AdamWOptions {
pub learning_rate: f64,
pub beta1: f64,
pub beta2: f64,
pub epsilon: f64,
pub weight_decay: f64,
pub max_iter: usize,
pub tol: f64,
pub lr_schedule: LearningRateSchedule,
pub gradient_clip: Option<f64>,
pub batch_size: Option<usize>,
pub decouple_weight_decay: bool,
}Expand description
Options for AdamW optimization
Fields§
§learning_rate: f64Learning rate (step size)
beta1: f64First moment decay parameter (momentum)
beta2: f64Second moment decay parameter (RMSProp-like)
epsilon: f64Small constant for numerical stability
weight_decay: f64Weight decay coefficient (L2 regularization strength)
max_iter: usizeMaximum number of iterations
tol: f64Convergence tolerance
lr_schedule: LearningRateScheduleLearning rate schedule
gradient_clip: Option<f64>Gradient clipping threshold
batch_size: Option<usize>Batch size for mini-batch optimization
decouple_weight_decay: boolDecouple weight decay from gradient-based update
Trait Implementations§
Source§impl Clone for AdamWOptions
impl Clone for AdamWOptions
Source§fn clone(&self) -> AdamWOptions
fn clone(&self) -> AdamWOptions
Returns a duplicate of the value. Read more
1.0.0 · Source§const fn clone_from(&mut self, source: &Self)
const fn clone_from(&mut self, source: &Self)
Performs copy-assignment from
source. Read moreSource§impl Debug for AdamWOptions
impl Debug for AdamWOptions
Auto Trait Implementations§
impl Freeze for AdamWOptions
impl RefUnwindSafe for AdamWOptions
impl Send for AdamWOptions
impl Sync for AdamWOptions
impl Unpin for AdamWOptions
impl UnwindSafe for AdamWOptions
Blanket Implementations§
Source§impl<T> BorrowMut<T> for Twhere
T: ?Sized,
impl<T> BorrowMut<T> for Twhere
T: ?Sized,
Source§fn borrow_mut(&mut self) -> &mut T
fn borrow_mut(&mut self) -> &mut T
Mutably borrows from an owned value. Read more
Source§impl<T> CloneToUninit for Twhere
T: Clone,
impl<T> CloneToUninit for Twhere
T: Clone,
Source§impl<T> IntoEither for T
impl<T> IntoEither for T
Source§fn into_either(self, into_left: bool) -> Either<Self, Self>
fn into_either(self, into_left: bool) -> Either<Self, Self>
Converts
self into a Left variant of Either<Self, Self>
if into_left is true.
Converts self into a Right variant of Either<Self, Self>
otherwise. Read moreSource§fn into_either_with<F>(self, into_left: F) -> Either<Self, Self>
fn into_either_with<F>(self, into_left: F) -> Either<Self, Self>
Converts
self into a Left variant of Either<Self, Self>
if into_left(&self) returns true.
Converts self into a Right variant of Either<Self, Self>
otherwise. Read moreSource§impl<T> Pointable for T
impl<T> Pointable for T
Source§impl<SS, SP> SupersetOf<SS> for SPwhere
SS: SubsetOf<SP>,
impl<SS, SP> SupersetOf<SS> for SPwhere
SS: SubsetOf<SP>,
Source§fn to_subset(&self) -> Option<SS>
fn to_subset(&self) -> Option<SS>
The inverse inclusion map: attempts to construct
self from the equivalent element of its
superset. Read moreSource§fn is_in_subset(&self) -> bool
fn is_in_subset(&self) -> bool
Checks if
self is actually part of its subset T (and can be converted to it).Source§fn to_subset_unchecked(&self) -> SS
fn to_subset_unchecked(&self) -> SS
Use with care! Same as
self.to_subset but without any property checks. Always succeeds.Source§fn from_subset(element: &SS) -> SP
fn from_subset(element: &SS) -> SP
The inclusion map: converts
self to the equivalent element of its superset.