pub enum GradientAccumulationStrategy {
Standard,
Average,
Checkpointing,
MixedPrecision,
}Expand description
Strategy for accumulating gradients
Variants§
Standard
Standard accumulation (sum gradients)
Average
Average gradients over accumulation steps
Checkpointing
Gradient checkpointing to save memory
MixedPrecision
Mixed precision accumulation
Trait Implementations§
Source§impl Clone for GradientAccumulationStrategy
impl Clone for GradientAccumulationStrategy
impl Copy for GradientAccumulationStrategy
Source§impl Debug for GradientAccumulationStrategy
impl Debug for GradientAccumulationStrategy
impl Eq for GradientAccumulationStrategy
impl StructuralPartialEq for GradientAccumulationStrategy
Auto Trait Implementations§
impl Freeze for GradientAccumulationStrategy
impl RefUnwindSafe for GradientAccumulationStrategy
impl Send for GradientAccumulationStrategy
impl Sync for GradientAccumulationStrategy
impl Unpin for GradientAccumulationStrategy
impl UnsafeUnpin for GradientAccumulationStrategy
impl UnwindSafe for GradientAccumulationStrategy
Blanket Implementations§
Source§impl<T> BorrowMut<T> for Twhere
T: ?Sized,
impl<T> BorrowMut<T> for Twhere
T: ?Sized,
Source§fn borrow_mut(&mut self) -> &mut T
fn borrow_mut(&mut self) -> &mut T
Mutably borrows from an owned value. Read more
impl<ST, DT> CastableFrom<ST, Initialized, Initialized> for DT
impl<ST, DT> CastableFrom<ST, Uninit, Uninit> for DT
Source§impl<T> CloneToUninit for Twhere
T: Clone,
impl<T> CloneToUninit for Twhere
T: Clone,
Source§impl<T> IntoEither for T
impl<T> IntoEither for T
Source§fn into_either(self, into_left: bool) -> Either<Self, Self> ⓘ
fn into_either(self, into_left: bool) -> Either<Self, Self> ⓘ
Converts
self into a Left variant of Either<Self, Self>
if into_left is true.
Converts self into a Right variant of Either<Self, Self>
otherwise. Read moreSource§fn into_either_with<F>(self, into_left: F) -> Either<Self, Self> ⓘ
fn into_either_with<F>(self, into_left: F) -> Either<Self, Self> ⓘ
Converts
self into a Left variant of Either<Self, Self>
if into_left(&self) returns true.
Converts self into a Right variant of Either<Self, Self>
otherwise. Read more