pub struct OptimizerConfig {
pub learning_rate: f64,
pub beta1: f64,
pub beta2: f64,
pub weight_decay: f64,
pub eps: f64,
}Expand description
Optimizer configuration.
Fields§
§learning_rate: f64Learning rate
beta1: f64Beta1 for Adam
beta2: f64Beta2 for Adam
weight_decay: f64Weight decay
eps: f64Epsilon for numerical stability
Implementations§
Source§impl OptimizerConfig
impl OptimizerConfig
Sourcepub fn build_adamw(
&self,
varmap: &VarMap,
) -> Result<AdamWOptimizer, AxolotlError>
pub fn build_adamw( &self, varmap: &VarMap, ) -> Result<AdamWOptimizer, AxolotlError>
Create AdamW optimizer with these parameters.
§Errors
Returns an error if the optimizer cannot be created.
Trait Implementations§
Source§impl Clone for OptimizerConfig
impl Clone for OptimizerConfig
Source§fn clone(&self) -> OptimizerConfig
fn clone(&self) -> OptimizerConfig
Returns a duplicate of the value. Read more
1.0.0 · Source§fn clone_from(&mut self, source: &Self)
fn clone_from(&mut self, source: &Self)
Performs copy-assignment from
source. Read moreSource§impl Debug for OptimizerConfig
impl Debug for OptimizerConfig
Source§impl Default for OptimizerConfig
impl Default for OptimizerConfig
Source§fn default() -> OptimizerConfig
fn default() -> OptimizerConfig
Returns the “default value” for a type. Read more
Auto Trait Implementations§
impl Freeze for OptimizerConfig
impl RefUnwindSafe for OptimizerConfig
impl Send for OptimizerConfig
impl Sync for OptimizerConfig
impl Unpin for OptimizerConfig
impl UnwindSafe for OptimizerConfig
Blanket Implementations§
Source§impl<T> BorrowMut<T> for Twhere
T: ?Sized,
impl<T> BorrowMut<T> for Twhere
T: ?Sized,
Source§fn borrow_mut(&mut self) -> &mut T
fn borrow_mut(&mut self) -> &mut T
Mutably borrows from an owned value. Read more
Source§impl<T> CloneToUninit for Twhere
T: Clone,
impl<T> CloneToUninit for Twhere
T: Clone,
Source§impl<T> Instrument for T
impl<T> Instrument for T
Source§fn instrument(self, span: Span) -> Instrumented<Self>
fn instrument(self, span: Span) -> Instrumented<Self>
Source§fn in_current_span(self) -> Instrumented<Self>
fn in_current_span(self) -> Instrumented<Self>
Source§impl<T> IntoEither for T
impl<T> IntoEither for T
Source§fn into_either(self, into_left: bool) -> Either<Self, Self>
fn into_either(self, into_left: bool) -> Either<Self, Self>
Converts
self into a Left variant of Either<Self, Self>
if into_left is true.
Converts self into a Right variant of Either<Self, Self>
otherwise. Read moreSource§fn into_either_with<F>(self, into_left: F) -> Either<Self, Self>
fn into_either_with<F>(self, into_left: F) -> Either<Self, Self>
Converts
self into a Left variant of Either<Self, Self>
if into_left(&self) returns true.
Converts self into a Right variant of Either<Self, Self>
otherwise. Read more