Enum ParallelizationStrategy 

pub enum ParallelizationStrategy {
    SingleThread,
    DataParallel {
        num_workers: usize,
    },
    ModelParallel {
        partition_strategy: PartitionStrategy,
    },
    Pipeline {
        pipeline_stages: usize,
        micro_batches: usize,
    },
    TensorParallel {
        tensor_parallel_size: usize,
    },
    Hybrid {
        data_parallel: usize,
        model_parallel: usize,
        pipeline_parallel: usize,
    },
}

Parallelization strategies

Variants

SingleThread

Single-threaded execution

DataParallel

Data parallelism

Fields

num_workers: usize

Number of parallel workers

ModelParallel

Model parallelism

Fields

partition_strategy: PartitionStrategy

Strategy for partitioning models

Pipeline

Pipeline parallelism

Fields

pipeline_stages: usize

Number of pipeline stages

micro_batches: usize

Number of micro-batches

TensorParallel

Tensor parallelism

Fields

tensor_parallel_size: usize

Size of tensor parallel group

Hybrid

Hybrid parallelism

Fields

data_parallel: usize

Data parallel size

model_parallel: usize

Model parallel size

pipeline_parallel: usize

Pipeline parallel size

Trait Implementations

impl Clone for ParallelizationStrategy

fn clone(&self) -> ParallelizationStrategy

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Debug for ParallelizationStrategy

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.