Enum ParallelismStrategy 

pub enum ParallelismStrategy {
    DataParallel,
    ModelParallel,
    PipelineParallel,
    Hybrid,
    ExpertParallel,
}

Multi-GPU parallelism strategies

Variants

DataParallel

Data parallelism - replicate model, split data

ModelParallel

Model parallelism - split model across GPUs

PipelineParallel

Pipeline parallelism - pipeline stages across GPUs

Hybrid

Hybrid parallelism - combination of strategies

ExpertParallel

Expert parallelism - for mixture of experts

Trait Implementations

impl Clone for ParallelismStrategy

fn clone(&self) -> ParallelismStrategy

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Debug for ParallelismStrategy

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl PartialEq for ParallelismStrategy

fn eq(&self, other: &ParallelismStrategy) -> bool

Tests for self and other values to be equal, and is used by ==.

fn ne(&self, other: &Rhs) -> bool

Tests for !=. The default implementation is almost always sufficient, and should not be overridden without very good reason.

impl Copy for ParallelismStrategy

impl Eq for ParallelismStrategy

impl StructuralPartialEq for ParallelismStrategy