Struct ModelCost 

pub struct ModelCost {
    pub n_layers: usize,
    pub per_layer_bytes: u64,
    pub embed_bytes: u64,
    pub head_bytes: u64,
    pub per_layer_flops: f64,
}

Resident-memory + compute cost model for a layer-stack model. Bytes are the ACTUAL per-node resident footprint (packed weights + kept scales), so the planner’s budgets are meaningful.

Fields

n_layers: usize

per_layer_bytes: u64

Average resident bytes per transformer layer.

embed_bytes: u64

Extra bytes on the FIRST stage (token embedding).

head_bytes: u64

Extra bytes on the LAST stage (final norm + LM head).

per_layer_flops: f64

Relative FLOPs per layer (for the throughput policy; 1.0 = uniform).

Implementations

impl ModelCost

pub fn total_bytes(&self) -> u64

Trait Implementations

impl Clone for ModelCost

fn clone(&self) -> ModelCost

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Debug for ModelCost

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.