Struct Cluster 

pub struct Cluster {
    pub cfg: ClusterConfig,
    pub caps: Vec<NodeCaps>,
    pub plan: Vec<Assignment>,
}

A configured, probed, planned cluster.

Fields

cfg: ClusterConfig

caps: Vec<NodeCaps>

Probed hardware, one per node (same order as cfg.nodes). Empty until Cluster::probe.

plan: Vec<Assignment>

Layer→node plan. Empty until Cluster::plan.

Implementations

impl Cluster

pub fn from_config(cfg: ClusterConfig) -> Self

pub fn from_path(p: impl AsRef<Path>) -> Result<Self>

pub fn probe(&mut self, remote_bin: &str) -> Result<&[NodeCaps]>

Probe every node’s hardware. remote_bin is the worker binary path on the remote hosts (its --probe mode self-reports); nodes without ssh are probed locally.

pub fn plan(&mut self, model: ModelCost) -> Result<&[Assignment]>

Plan placement from the model cost model + probed caps (probe first).

pub fn worker_argv(&self, i: usize) -> Vec<String>

The worker command-line for node i from its plan + config — so the model crate’s worker binary honours device / precision / rng / kv / layers.

pub fn launch(&self, remote_bin: &str) -> Result<Vec<Child>>

Spawn a worker process per node (ssh for remote, local otherwise). The caller drives them via Cluster::drive, then reaps the children.

pub fn drive(&self, inputs: Vec<NamedTensor>) -> Result<ClusterRun>

Drive one forward through the planned stages, timing each, and collect the output. inputs seeds the first stage (e.g. input_ids). Boundary tensor name is hidden/hidden_in per the model’s stage I/O convention.