pub enum MemberSharding {
Replicated,
Equal {
axis: usize,
},
Balanced {
axis: usize,
},
Partitioned {
axis: usize,
},
PartitionedSegments {
axis: usize,
segments: Vec<Range<usize>>,
},
Segmented {
axis: usize,
segments: Vec<Range<usize>>,
},
}Expand description
Rank-local selection rule for one physical checkpoint tensor.
Variants§
Replicated
Materialize the complete member on every tensor-parallel rank.
Equal
Split an axis into equal contiguous shards.
Balanced
Split an axis into balanced, potentially uneven contiguous ranges.
Partitioned
Map the group’s logical partition onto one physical tensor axis.
PartitionedSegments
Map the same group-level logical range into each supplied source segment.
Fields
Segmented
Partition each supplied source range independently.
Trait Implementations§
Source§impl Clone for MemberSharding
impl Clone for MemberSharding
Source§fn clone(&self) -> MemberSharding
fn clone(&self) -> MemberSharding
Returns a duplicate of the value. Read more
1.0.0 (const: unstable) · Source§fn clone_from(&mut self, source: &Self)
fn clone_from(&mut self, source: &Self)
Performs copy-assignment from
source. Read moreSource§impl Debug for MemberSharding
impl Debug for MemberSharding
impl Eq for MemberSharding
Source§impl PartialEq for MemberSharding
impl PartialEq for MemberSharding
impl StructuralPartialEq for MemberSharding
Auto Trait Implementations§
impl Freeze for MemberSharding
impl RefUnwindSafe for MemberSharding
impl Send for MemberSharding
impl Sync for MemberSharding
impl Unpin for MemberSharding
impl UnsafeUnpin for MemberSharding
impl UnwindSafe for MemberSharding
Blanket Implementations§
Source§impl<T> BorrowMut<T> for Twhere
T: ?Sized,
impl<T> BorrowMut<T> for Twhere
T: ?Sized,
Source§fn borrow_mut(&mut self) -> &mut T
fn borrow_mut(&mut self) -> &mut T
Mutably borrows from an owned value. Read more