Skip to main content

model_weight_bytes

inference_lab::compute::arithmetic

Function model_weight_bytes 

Source 
pub fn model_weight_bytes(model: &ModelConfig, hardware: &HardwareConfig) -> f64
Expand description

Calculate memory transfer bytes for model weights Formula: weight_bytes = num_parameters * bytes_per_param