Struct GroupMember 

pub struct GroupMember { /* private fields */ }

One member of a ClientGroup, queueing its own part of each collective over the group.

Every member queues its part of every collective over the group, and in one order on every member: the members wait for each other on their devices, so a part queued out of order, or never, hangs the others. Two callers queueing over one group agree on that order themselves. Each part is checked against its own member’s buffers only: sources of different sizes on different members fail on the devices instead.

Implementations

impl GroupMember

pub fn rank(&self) -> usize

This member’s rank in its group.

pub fn all_reduce( &self, buffers: MemberBuffers, dtype: ElemType, op: ReduceOperation, )

This member’s part of ClientGroup::all_reduce.

pub fn all_gather(&self, buffers: MemberBuffers)

This member’s part of ClientGroup::all_gather.

pub fn reduce_scatter( &self, buffers: MemberBuffers, dtype: ElemType, op: ReduceOperation, )

This member’s part of ClientGroup::reduce_scatter.

pub fn all_to_all(&self, buffers: MemberBuffers)

This member’s part of ClientGroup::all_to_all.

Trait Implementations

impl Clone for GroupMember

fn clone(&self) -> GroupMember

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.