Struct HostLayout 

pub struct HostLayout {
    pub groups: Vec<GroupLayout>,
    pub lcm_block_bytes: usize,
    pub num_lcm_blocks: usize,
    pub owner_rank: usize,
    pub tp_rank: usize,
}

The Host pool’s geometry and this rank’s place among the owners.

Fields

groups: Vec<GroupLayout>

Each group, in the scheduler’s group order.

lcm_block_bytes: usize

Bytes of one LCM block.

num_lcm_blocks: usize

LCM blocks in the pool, the null block excluded.

owner_rank: usize

This rank among a sharded group’s owners (the KV-parallel rank).

tp_rank: usize

This rank’s attention-TP rank.

Implementations

impl HostLayout

pub fn bytes(&self) -> usize

The pool’s size.

pub fn owned_range( &self, group: u32, block: i32, ) -> Result<Option<Range>, LayoutError>

The bytes of group’s scheduler block block on this rank, or None when another rank owns it.

pub fn block_bytes(&self, group: u32) -> Result<usize, LayoutError>

The bytes of one of group’s blocks, owned here or not.

pub fn key_rank(&self, group: u32) -> Result<i64, LayoutError>

The rank an object key of group names: the owners of a sharded group share one name per shard, so a later allocation may move a block to another owner of it.

Trait Implementations

impl Clone for HostLayout

fn clone(&self) -> Self

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Debug for HostLayout

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl Eq for HostLayout

impl PartialEq for HostLayout

fn eq(&self, other: &Self) -> bool

Equality operator ==.

fn ne(&self, other: &Rhs) -> bool

Inequality operator !=.

impl StructuralPartialEq for HostLayout