pub struct ParamStateSnapshot {
pub param_name: String,
pub step: u64,
pub first_moment: Option<Vec<f64>>,
pub second_moment: Option<Vec<f64>>,
pub momentum: Option<Vec<f64>>,
pub ema: Option<Vec<f64>>,
pub grad_norm: Option<f64>,
}Expand description
A snapshot of optimizer state for one parameter.
Fields§
§param_name: String§step: u64§first_moment: Option<Vec<f64>>First moment (m) — Adam exponential moving average of gradient.
second_moment: Option<Vec<f64>>Second moment (v) — Adam exponential moving average of squared gradient.
momentum: Option<Vec<f64>>SGD momentum buffer.
ema: Option<Vec<f64>>EMA weights for Lion optimizer.
grad_norm: Option<f64>Last observed gradient norm.
Implementations§
Trait Implementations§
Source§impl Clone for ParamStateSnapshot
impl Clone for ParamStateSnapshot
Source§fn clone(&self) -> ParamStateSnapshot
fn clone(&self) -> ParamStateSnapshot
Returns a duplicate of the value. Read more
1.0.0 (const: unstable) · Source§fn clone_from(&mut self, source: &Self)
fn clone_from(&mut self, source: &Self)
Performs copy-assignment from
source. Read moreAuto Trait Implementations§
impl Freeze for ParamStateSnapshot
impl RefUnwindSafe for ParamStateSnapshot
impl Send for ParamStateSnapshot
impl Sync for ParamStateSnapshot
impl Unpin for ParamStateSnapshot
impl UnsafeUnpin for ParamStateSnapshot
impl UnwindSafe for ParamStateSnapshot
Blanket Implementations§
Source§impl<T> BorrowMut<T> for Twhere
T: ?Sized,
impl<T> BorrowMut<T> for Twhere
T: ?Sized,
Source§fn borrow_mut(&mut self) -> &mut T
fn borrow_mut(&mut self) -> &mut T
Mutably borrows from an owned value. Read more
impl<ST, DT> CastableFrom<ST, Initialized, Initialized> for DT
impl<ST, DT> CastableFrom<ST, Uninit, Uninit> for DT
Source§impl<T> CloneToUninit for Twhere
T: Clone,
impl<T> CloneToUninit for Twhere
T: Clone,
Source§impl<T> Instrument for T
impl<T> Instrument for T
Source§fn instrument(self, span: Span) -> Instrumented<Self>
fn instrument(self, span: Span) -> Instrumented<Self>
Source§fn in_current_span(self) -> Instrumented<Self>
fn in_current_span(self) -> Instrumented<Self>
Source§impl<T> IntoEither for T
impl<T> IntoEither for T
Source§fn into_either(self, into_left: bool) -> Either<Self, Self>
fn into_either(self, into_left: bool) -> Either<Self, Self>
Converts
self into a Left variant of Either<Self, Self>
if into_left is true.
Converts self into a Right variant of Either<Self, Self>
otherwise. Read moreSource§fn into_either_with<F>(self, into_left: F) -> Either<Self, Self>
fn into_either_with<F>(self, into_left: F) -> Either<Self, Self>
Converts
self into a Left variant of Either<Self, Self>
if into_left(&self) returns true.
Converts self into a Right variant of Either<Self, Self>
otherwise. Read more