pub struct ProdigyConfig {
pub lr: f32,
pub beta1: f32,
pub beta2: f32,
pub growth_rate: f32,
pub initial_d: f32,
pub weight_decay: f32,
pub eps: f32,
pub warmup_steps: usize,
}Expand description
Prodigy optimizer configuration
Fields§
§lr: f32Learning rate (use 1.0 for most problems!)
beta1: f32Beta1 for momentum (typically 0.9)
beta2: f32Beta2 for variance (typically 0.999)
growth_rate: f32Growth rate for d adaptation (typically 1.0)
initial_d: f32Initial d estimate (typically 1e-6)
weight_decay: f32Weight decay coefficient
eps: f32Epsilon for numerical stability
warmup_steps: usizeWarmup steps (0 for no warmup)
Trait Implementations§
Source§impl Clone for ProdigyConfig
impl Clone for ProdigyConfig
Source§fn clone(&self) -> ProdigyConfig
fn clone(&self) -> ProdigyConfig
Returns a duplicate of the value. Read more
1.0.0 (const: unstable) · Source§fn clone_from(&mut self, source: &Self)
fn clone_from(&mut self, source: &Self)
Performs copy-assignment from
source. Read moreSource§impl Debug for ProdigyConfig
impl Debug for ProdigyConfig
Auto Trait Implementations§
impl Freeze for ProdigyConfig
impl RefUnwindSafe for ProdigyConfig
impl Send for ProdigyConfig
impl Sync for ProdigyConfig
impl Unpin for ProdigyConfig
impl UnsafeUnpin for ProdigyConfig
impl UnwindSafe for ProdigyConfig
Blanket Implementations§
Source§impl<T> BorrowMut<T> for Twhere
T: ?Sized,
impl<T> BorrowMut<T> for Twhere
T: ?Sized,
Source§fn borrow_mut(&mut self) -> &mut T
fn borrow_mut(&mut self) -> &mut T
Mutably borrows from an owned value. Read more
impl<ST, DT> CastableFrom<ST, Initialized, Initialized> for DT
impl<ST, DT> CastableFrom<ST, Uninit, Uninit> for DT
Source§impl<T> CloneToUninit for Twhere
T: Clone,
impl<T> CloneToUninit for Twhere
T: Clone,
Source§impl<T> IntoEither for T
impl<T> IntoEither for T
Source§fn into_either(self, into_left: bool) -> Either<Self, Self> ⓘ
fn into_either(self, into_left: bool) -> Either<Self, Self> ⓘ
Converts
self into a Left variant of Either<Self, Self>
if into_left is true.
Converts self into a Right variant of Either<Self, Self>
otherwise. Read moreSource§fn into_either_with<F>(self, into_left: F) -> Either<Self, Self> ⓘ
fn into_either_with<F>(self, into_left: F) -> Either<Self, Self> ⓘ
Converts
self into a Left variant of Either<Self, Self>
if into_left(&self) returns true.
Converts self into a Right variant of Either<Self, Self>
otherwise. Read more