pub enum ZeRoStage {
Stage1,
Stage2,
Stage3,
}Expand description
ZeRO stage configuration
Variants§
Stage1
Stage 1: Optimizer state partitioning
Stage2
Stage 2: Gradient partitioning
Stage3
Stage 3: Parameter partitioning
Trait Implementations§
impl Copy for ZeRoStage
impl StructuralPartialEq for ZeRoStage
Auto Trait Implementations§
impl Freeze for ZeRoStage
impl RefUnwindSafe for ZeRoStage
impl Send for ZeRoStage
impl Sync for ZeRoStage
impl Unpin for ZeRoStage
impl UnwindSafe for ZeRoStage
Blanket Implementations§
Source§impl<T> BorrowMut<T> for Twhere
T: ?Sized,
impl<T> BorrowMut<T> for Twhere
T: ?Sized,
Source§fn borrow_mut(&mut self) -> &mut T
fn borrow_mut(&mut self) -> &mut T
Mutably borrows from an owned value. Read more
Source§impl<T> CloneToUninit for Twhere
T: Clone,
impl<T> CloneToUninit for Twhere
T: Clone,
Source§impl<T> IntoEither for T
impl<T> IntoEither for T
Source§fn into_either(self, into_left: bool) -> Either<Self, Self>
fn into_either(self, into_left: bool) -> Either<Self, Self>
Converts
self into a Left variant of Either<Self, Self>
if into_left is true.
Converts self into a Right variant of Either<Self, Self>
otherwise. Read moreSource§fn into_either_with<F>(self, into_left: F) -> Either<Self, Self>
fn into_either_with<F>(self, into_left: F) -> Either<Self, Self>
Converts
self into a Left variant of Either<Self, Self>
if into_left(&self) returns true.
Converts self into a Right variant of Either<Self, Self>
otherwise. Read more