Struct PrefillLayout 

pub struct PrefillLayout {
    pub local: Contract,
    pub wire: Contract,
    pub arena_base: u64,
    pub tp_size: i64,
    pub tp_rank: i64,
    pub pp_rank: i64,
    pub fields_by_stage: Vec<Vec<String>>,
}

What a Prefill rank plans its routes and copies with.

Fields

local: Contract

This rank’s contract, with its landing addresses: the stage’s resident fields only under a pipeline.

wire: Contract

The logical contract every rank registers with the bootstrap server: the complete model’s, without addresses.

arena_base: u64

This rank’s arena base.

tp_size: i64

The attention TP size within a stage.

tp_rank: i64

This rank’s attention TP rank.

pp_rank: i64

This rank’s pipeline stage.

fields_by_stage: Vec<Vec<String>>

Every stage’s resident fields.

Trait Implementations

impl Clone for PrefillLayout

fn clone(&self) -> Self

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Debug for PrefillLayout

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.