#[non_exhaustive]pub struct TensorShardSpec {
pub full_shape: Vec<usize>,
pub shard_dim: usize,
pub shard_sizes: Vec<usize>,
}Expand description
Describes how a single tensor is sharded across ranks.
Marked #[non_exhaustive] so future fields (e.g., dtype, ordering,
per-rank ranges for non-uniform shards) can be added without a major
version bump. Construct via in-crate helpers (e.g.
flat_shard_metadata) and access fields by name.
Fields (Non-exhaustive)§
This struct is marked as non-exhaustive
Non-exhaustive structs could have additional fields added in future. Therefore, non-exhaustive structs cannot be constructed in external crates using the traditional
Struct { .. } syntax; cannot be matched against without a wildcard ..; and struct update syntax will not work.full_shape: Vec<usize>Full (unsharded) shape of the tensor.
shard_dim: usizeWhich dimension is split across ranks.
shard_sizes: Vec<usize>Size along shard_dim for each rank. The sum must equal
full_shape[shard_dim].
Trait Implementations§
Source§impl Clone for TensorShardSpec
impl Clone for TensorShardSpec
Source§fn clone(&self) -> TensorShardSpec
fn clone(&self) -> TensorShardSpec
Returns a duplicate of the value. Read more
1.0.0 (const: unstable) · Source§fn clone_from(&mut self, source: &Self)
fn clone_from(&mut self, source: &Self)
Performs copy-assignment from
source. Read moreSource§impl Debug for TensorShardSpec
impl Debug for TensorShardSpec
Source§impl<'de> Deserialize<'de> for TensorShardSpec
impl<'de> Deserialize<'de> for TensorShardSpec
Source§fn deserialize<__D>(__deserializer: __D) -> Result<Self, __D::Error>where
__D: Deserializer<'de>,
fn deserialize<__D>(__deserializer: __D) -> Result<Self, __D::Error>where
__D: Deserializer<'de>,
Deserialize this value from the given Serde deserializer. Read more
Auto Trait Implementations§
impl Freeze for TensorShardSpec
impl RefUnwindSafe for TensorShardSpec
impl Send for TensorShardSpec
impl Sync for TensorShardSpec
impl Unpin for TensorShardSpec
impl UnsafeUnpin for TensorShardSpec
impl UnwindSafe for TensorShardSpec
Blanket Implementations§
Source§impl<T> BorrowMut<T> for Twhere
T: ?Sized,
impl<T> BorrowMut<T> for Twhere
T: ?Sized,
Source§fn borrow_mut(&mut self) -> &mut T
fn borrow_mut(&mut self) -> &mut T
Mutably borrows from an owned value. Read more
Source§impl<T> CloneToUninit for Twhere
T: Clone,
impl<T> CloneToUninit for Twhere
T: Clone,
Source§impl<T> DistributionExt for Twhere
T: ?Sized,
impl<T> DistributionExt for Twhere
T: ?Sized,
Source§impl<T> Instrument for T
impl<T> Instrument for T
Source§fn instrument(self, span: Span) -> Instrumented<Self>
fn instrument(self, span: Span) -> Instrumented<Self>
Source§fn in_current_span(self) -> Instrumented<Self>
fn in_current_span(self) -> Instrumented<Self>
Source§impl<T> IntoEither for T
impl<T> IntoEither for T
Source§fn into_either(self, into_left: bool) -> Either<Self, Self>
fn into_either(self, into_left: bool) -> Either<Self, Self>
Converts
self into a Left variant of Either<Self, Self>
if into_left is true.
Converts self into a Right variant of Either<Self, Self>
otherwise. Read moreSource§fn into_either_with<F>(self, into_left: F) -> Either<Self, Self>
fn into_either_with<F>(self, into_left: F) -> Either<Self, Self>
Converts
self into a Left variant of Either<Self, Self>
if into_left(&self) returns true.
Converts self into a Right variant of Either<Self, Self>
otherwise. Read more