Enum Placement 

pub enum Placement {
    Replicate,
    Shard(usize),
    Partial(ReduceOp),
}

How a tensor relates to ranks along one mesh dimension.

Variants

Replicate

Every rank in this mesh dim holds a full copy of the tensor.

Shard(usize)

The tensor is split along tensor-dim dim across ranks in this mesh dim. Each rank’s local shard has size global_shape[dim] / mesh_size_along_this_dim (caller’s responsibility to ensure even divisibility).

Partial(ReduceOp)

Each rank holds an unreduced contribution; a pending reduction with op collapses to Replicate.

Implementations

impl Placement

pub fn is_replicate(&self) -> bool

pub fn is_shard(&self) -> bool

pub fn is_partial(&self) -> bool

pub fn shard_dim(&self) -> Option<usize>

Which tensor dim is sharded by this placement, if any.

Trait Implementations

impl Clone for Placement

fn clone(&self) -> Placement

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Debug for Placement

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl PartialEq for Placement

fn eq(&self, other: &Placement) -> bool

Tests for self and other values to be equal, and is used by ==.

fn ne(&self, other: &Rhs) -> bool

Tests for !=. The default implementation is almost always sufficient, and should not be overridden without very good reason.

impl Copy for Placement

impl StructuralPartialEq for Placement