pub enum GcStrategy {
LayerWise,
Global,
PerRow,
PerColumn,
}Expand description
Gradient centralization strategy.
Variants§
LayerWise
Centralize each layer’s gradients independently (most common). For each parameter matrix: g = g - mean(g)
Global
Centralize all gradients globally (experimental). Compute global mean across all parameters: g_all = g_all - mean(g_all)
PerRow
Centralize per row (for weight matrices). For weight matrix: g[i,:] = g[i,:] - mean(g[i,:])
PerColumn
Centralize per column (for weight matrices). For weight matrix: g[:,j] = g[:,j] - mean(g[:,j])
Trait Implementations§
Source§impl Clone for GcStrategy
impl Clone for GcStrategy
Source§fn clone(&self) -> GcStrategy
fn clone(&self) -> GcStrategy
Returns a duplicate of the value. Read more
1.0.0 · Source§fn clone_from(&mut self, source: &Self)
fn clone_from(&mut self, source: &Self)
Performs copy-assignment from
source. Read moreSource§impl Debug for GcStrategy
impl Debug for GcStrategy
Source§impl Default for GcStrategy
impl Default for GcStrategy
Source§fn default() -> GcStrategy
fn default() -> GcStrategy
Returns the “default value” for a type. Read more
Source§impl PartialEq for GcStrategy
impl PartialEq for GcStrategy
impl Copy for GcStrategy
impl StructuralPartialEq for GcStrategy
Auto Trait Implementations§
impl Freeze for GcStrategy
impl RefUnwindSafe for GcStrategy
impl Send for GcStrategy
impl Sync for GcStrategy
impl Unpin for GcStrategy
impl UnwindSafe for GcStrategy
Blanket Implementations§
Source§impl<T> BorrowMut<T> for Twhere
T: ?Sized,
impl<T> BorrowMut<T> for Twhere
T: ?Sized,
Source§fn borrow_mut(&mut self) -> &mut T
fn borrow_mut(&mut self) -> &mut T
Mutably borrows from an owned value. Read more
Source§impl<T> CloneToUninit for Twhere
T: Clone,
impl<T> CloneToUninit for Twhere
T: Clone,
Source§impl<T> IntoEither for T
impl<T> IntoEither for T
Source§fn into_either(self, into_left: bool) -> Either<Self, Self>
fn into_either(self, into_left: bool) -> Either<Self, Self>
Converts
self into a Left variant of Either<Self, Self>
if into_left is true.
Converts self into a Right variant of Either<Self, Self>
otherwise. Read moreSource§fn into_either_with<F>(self, into_left: F) -> Either<Self, Self>
fn into_either_with<F>(self, into_left: F) -> Either<Self, Self>
Converts
self into a Left variant of Either<Self, Self>
if into_left(&self) returns true.
Converts self into a Right variant of Either<Self, Self>
otherwise. Read more