Struct ParallelModelInfo 

pub struct ParallelModelInfo<T> { /* private fields */ }

Architecture-neutral information for one rank-local parallel model.

Implementations

impl<T> ParallelModelInfo<T>

pub fn new( topology: T, effective_model_type: impl Into<String>, owned_tensors: Vec<String>, local_parameter_bytes: u64, global_parameter_bytes: u64, pinned_device_parameter_bytes: u64, maximum_device_parameter_bytes: u64, ) -> Self

Creates a complete rank-local parallel model summary.

pub fn topology(&self) -> T

where T: Clone,

Returns the backend’s concrete topology value unchanged.

pub fn effective_model_type(&self) -> &str

Returns the parsed implementation or nested text-model type.

pub fn owned_tensors(&self) -> &[String]

Returns exact checkpoint targets owned or replicated by this rank.

pub const fn local_parameter_bytes(&self) -> u64

Returns planned rank-local parameter bytes across static and execution units.

pub const fn global_parameter_bytes(&self) -> u64

Returns the unsharded model parameter bytes represented by this checkpoint.

pub const fn pinned_device_parameter_bytes(&self) -> u64

Returns rank-local parameter bytes permanently pinned on the execution device.

pub const fn maximum_device_parameter_bytes(&self) -> u64

Returns the maximum planned rank-local parameter footprint on device.

Trait Implementations

impl<T: Clone> Clone for ParallelModelInfo<T>

fn clone(&self) -> ParallelModelInfo<T>

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl<T: Debug> Debug for ParallelModelInfo<T>

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.