pub struct OptimizerState<T: Float + Debug + Send + Sync + 'static> {
pub parameters: Array1<T>,
pub gradients: Array1<T>,
pub momentum: Option<Array1<T>>,
pub hidden_states: HashMap<String, Array1<T>>,
pub memory_buffers: HashMap<String, Array2<T>>,
pub step: usize,
pub step_count: usize,
pub loss: Option<T>,
pub learning_rate: T,
pub metadata: StateMetadata,
}Expand description
Base optimizer state
Fields§
§parameters: Array1<T>Current parameters
gradients: Array1<T>Current gradients
momentum: Option<Array1<T>>Momentum buffer
Hidden states for neural optimizers
memory_buffers: HashMap<String, Array2<T>>Memory buffers for attention mechanisms
step: usizeCurrent step number
step_count: usizeStep count (alias for step)
loss: Option<T>Current loss value
learning_rate: TLearning rate schedule
metadata: StateMetadataAdditional state metadata
Implementations§
Trait Implementations§
Auto Trait Implementations§
impl<T> Freeze for OptimizerState<T>where
T: Freeze,
impl<T> RefUnwindSafe for OptimizerState<T>where
T: RefUnwindSafe,
impl<T> Send for OptimizerState<T>
impl<T> Sync for OptimizerState<T>
impl<T> Unpin for OptimizerState<T>where
T: Unpin,
impl<T> UnwindSafe for OptimizerState<T>where
T: UnwindSafe + RefUnwindSafe,
Blanket Implementations§
Source§impl<T> BorrowMut<T> for Twhere
T: ?Sized,
impl<T> BorrowMut<T> for Twhere
T: ?Sized,
Source§fn borrow_mut(&mut self) -> &mut T
fn borrow_mut(&mut self) -> &mut T
Mutably borrows from an owned value. Read more
Source§impl<T> CloneToUninit for Twhere
T: Clone,
impl<T> CloneToUninit for Twhere
T: Clone,
Source§impl<T> IntoEither for T
impl<T> IntoEither for T
Source§fn into_either(self, into_left: bool) -> Either<Self, Self>
fn into_either(self, into_left: bool) -> Either<Self, Self>
Converts
self into a Left variant of Either<Self, Self>
if into_left is true.
Converts self into a Right variant of Either<Self, Self>
otherwise. Read moreSource§fn into_either_with<F>(self, into_left: F) -> Either<Self, Self>
fn into_either_with<F>(self, into_left: F) -> Either<Self, Self>
Converts
self into a Left variant of Either<Self, Self>
if into_left(&self) returns true.
Converts self into a Right variant of Either<Self, Self>
otherwise. Read moreSource§impl<T> Pointable for T
impl<T> Pointable for T
Source§impl<SS, SP> SupersetOf<SS> for SPwhere
SS: SubsetOf<SP>,
impl<SS, SP> SupersetOf<SS> for SPwhere
SS: SubsetOf<SP>,
Source§fn to_subset(&self) -> Option<SS>
fn to_subset(&self) -> Option<SS>
The inverse inclusion map: attempts to construct
self from the equivalent element of its
superset. Read moreSource§fn is_in_subset(&self) -> bool
fn is_in_subset(&self) -> bool
Checks if
self is actually part of its subset T (and can be converted to it).Source§fn to_subset_unchecked(&self) -> SS
fn to_subset_unchecked(&self) -> SS
Use with care! Same as
self.to_subset but without any property checks. Always succeeds.Source§fn from_subset(element: &SS) -> SP
fn from_subset(element: &SS) -> SP
The inclusion map: converts
self to the equivalent element of its superset.Source§impl<SS, SP> SupersetOf<SS> for SPwhere
SS: SubsetOf<SP>,
impl<SS, SP> SupersetOf<SS> for SPwhere
SS: SubsetOf<SP>,
Source§fn to_subset(&self) -> Option<SS>
fn to_subset(&self) -> Option<SS>
The inverse inclusion map: attempts to construct
self from the equivalent element of its
superset. Read moreSource§fn is_in_subset(&self) -> bool
fn is_in_subset(&self) -> bool
Checks if
self is actually part of its subset T (and can be converted to it).Source§fn to_subset_unchecked(&self) -> SS
fn to_subset_unchecked(&self) -> SS
Use with care! Same as
self.to_subset but without any property checks. Always succeeds.Source§fn from_subset(element: &SS) -> SP
fn from_subset(element: &SS) -> SP
The inclusion map: converts
self to the equivalent element of its superset.