Enum CommunicationOp 

pub enum CommunicationOp {
    AllReduce {
        reduction: ReductionOp,
    },
    Broadcast {
        src_rank: usize,
    },
    Scatter {
        src_rank: usize,
    },
    Gather {
        dst_rank: usize,
    },
    AllGather,
    ReduceScatter {
        reduction: ReductionOp,
    },
    Send {
        dst_rank: usize,
    },
    Recv {
        src_rank: usize,
    },
}

Communication operation for distributed execution.

Variants

AllReduce

All-reduce: reduce values across all devices

Fields

reduction: ReductionOp

Reduction operation (sum, mean, max, min)

Broadcast

Broadcast: send from one device to all others

Fields

src_rank: usize

Source device rank

Scatter

Scatter: distribute data from one device to all

Fields

src_rank: usize

Source device rank

Gather

Gather: collect data from all devices to one

Fields

dst_rank: usize

Destination device rank

AllGather

All-gather: gather data from all devices to all

ReduceScatter

Reduce-scatter: reduce and scatter results

Fields

reduction: ReductionOp

Reduction operation

Send

Peer-to-peer send

Fields

dst_rank: usize

Destination device rank

Recv

Peer-to-peer receive

Fields

src_rank: usize

Source device rank

Trait Implementations

impl Clone for CommunicationOp

fn clone(&self) -> CommunicationOp

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Debug for CommunicationOp

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl PartialEq for CommunicationOp

fn eq(&self, other: &CommunicationOp) -> bool

Tests for self and other values to be equal, and is used by ==.

fn ne(&self, other: &Rhs) -> bool

Tests for !=. The default implementation is almost always sufficient, and should not be overridden without very good reason.

impl Eq for CommunicationOp

impl StructuralPartialEq for CommunicationOp