pub enum DistributedStrategy {
DataParallel,
ModelParallel,
HybridParallel,
PipelineParallel,
}
Expand description
Distributed training strategy.
Variants§
DataParallel
Data parallelism - same model on each worker, different data.
ModelParallel
Model parallelism - different parts of the model on each worker.
HybridParallel
Hybrid parallelism - combination of data and model parallelism.
PipelineParallel
Pipeline parallelism - model stages executed in a pipeline.
Trait Implementations§
Source§impl Clone for DistributedStrategy
impl Clone for DistributedStrategy
Source§fn clone(&self) -> DistributedStrategy
fn clone(&self) -> DistributedStrategy
Returns a duplicate of the value. Read more
1.0.0 · Source§fn clone_from(&mut self, source: &Self)
fn clone_from(&mut self, source: &Self)
Performs copy-assignment from
source
. Read moreSource§impl Debug for DistributedStrategy
impl Debug for DistributedStrategy
Source§impl Display for DistributedStrategy
impl Display for DistributedStrategy
Source§impl PartialEq for DistributedStrategy
impl PartialEq for DistributedStrategy
impl Copy for DistributedStrategy
impl Eq for DistributedStrategy
impl StructuralPartialEq for DistributedStrategy
Auto Trait Implementations§
impl Freeze for DistributedStrategy
impl RefUnwindSafe for DistributedStrategy
impl Send for DistributedStrategy
impl Sync for DistributedStrategy
impl Unpin for DistributedStrategy
impl UnwindSafe for DistributedStrategy
Blanket Implementations§
Source§impl<T> BorrowMut<T> for Twhere
T: ?Sized,
impl<T> BorrowMut<T> for Twhere
T: ?Sized,
Source§fn borrow_mut(&mut self) -> &mut T
fn borrow_mut(&mut self) -> &mut T
Mutably borrows from an owned value. Read more
Source§impl<T> CloneToUninit for Twhere
T: Clone,
impl<T> CloneToUninit for Twhere
T: Clone,
Source§impl<T> IntoEither for T
impl<T> IntoEither for T
Source§fn into_either(self, into_left: bool) -> Either<Self, Self>
fn into_either(self, into_left: bool) -> Either<Self, Self>
Converts
self
into a Left
variant of Either<Self, Self>
if into_left
is true
.
Converts self
into a Right
variant of Either<Self, Self>
otherwise. Read moreSource§fn into_either_with<F>(self, into_left: F) -> Either<Self, Self>
fn into_either_with<F>(self, into_left: F) -> Either<Self, Self>
Converts
self
into a Left
variant of Either<Self, Self>
if into_left(&self)
returns true
.
Converts self
into a Right
variant of Either<Self, Self>
otherwise. Read more