Struct Assignment 

pub struct Assignment {

    pub addr: String,
    pub ssh: Option<String>,
    pub layers: Range<usize>,
    pub first: bool,
    pub last: bool,
    pub est_bytes: u64,
    pub budget_bytes: u64,
    pub est_disk_bytes: u64,
    pub experts_paged: bool,
    pub est_stage_secs: f64,
    pub est_kv_bytes: u64,
    pub device: String,
    pub role: NodeRole,
    pub backs: Option<String>,
}

One node’s stage.

Fields

addr: String

ssh: Option<String>

layers: Range<usize>

first: bool

last: bool

est_bytes: u64

Estimated resident bytes for this stage (weights + embed/head), excluding routed experts when those page from disk.

budget_bytes: u64

The node’s stage RAM budget the planner used.

est_disk_bytes: u64

Routed-expert bytes this stage must keep on disk (0 for a dense model, or when the experts fit in RAM alongside the resident weights).

experts_paged: bool

True when this stage’s experts page from disk rather than sitting in RAM. Paged stages are bounded by NodeCaps::io_mbps, not by GFLOP/s.

est_stage_secs: f64

Predicted seconds per token for this stage: compute time plus, when paged, the time to stream in the experts each token touches. The planner balances the pipeline by minimizing the largest of these.

est_kv_bytes: u64

KV-cache bytes THIS stage will hold at the objective’s context — exact for its actual layer range, not the stack average.

device: String

Primary device label for the monitor.

role: NodeRole

Active / standby / draining, from NodeConfig::role.

backs: Option<String>

For a standby: the addr of the active node whose layers it mirrors.

Trait Implementations

impl Clone for Assignment

fn clone(&self) -> Self

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Debug for Assignment

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.