Struct CacheShardInfo 

pub struct CacheShardInfo { /* private fields */ }

Identifies a shard of the distributed cache.

Implementations

impl CacheShardInfo

pub fn new(rank: usize, world_size: usize, num_layers: usize) -> Self

Create a shard info that assigns layers evenly across ranks.

Layers are assigned contiguously: rank 0 gets layers [0..per_rank), rank 1 gets [per_rank..2*per_rank), etc.

pub fn with_layers( rank: usize, world_size: usize, num_layers: usize, layers: Vec<usize>, ) -> Self

Create a shard with explicit layer assignments.

pub fn rank(&self) -> usize

Rank of this shard.

pub fn world_size(&self) -> usize

World size.

pub fn num_layers(&self) -> usize

Total layers in the model.

pub fn layers(&self) -> &[usize]

Layers this shard is responsible for.

pub fn owns_layer(&self, layer: usize) -> bool

Whether this shard owns a given layer.

Trait Implementations

impl Clone for CacheShardInfo

fn clone(&self) -> Self

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Debug for CacheShardInfo

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl<'de> Deserialize<'de> for CacheShardInfo

fn deserialize<__D>(__deserializer: __D) -> Result<Self, __D::Error>

where __D: Deserializer<'de>,

Deserialize this value from the given Serde deserializer.

impl Serialize for CacheShardInfo

fn serialize<__S>(&self, __serializer: __S) -> Result<__S::Ok, __S::Error>

where __S: Serializer,

Serialize this value into the given Serde serializer.