Struct ParameterGroup 

pub struct ParameterGroup {
    pub name: String,
    pub parameter_names: Vec<String>,
    pub local_parameters: HashMap<String, Tensor>,
    pub partition_info: PartitionInfo,
}

Parameter group for ZeRO optimization

Fields

name: String

Group name/identifier

parameter_names: Vec<String>

Parameter names in this group

local_parameters: HashMap<String, Tensor>

Local partition of parameters

partition_info: PartitionInfo

Metadata for parameter partitioning

Implementations

impl ParameterGroup

pub fn new(name: String, parameter_names: Vec<String>) -> Self

pub fn add_parameter(&mut self, name: String, tensor: Tensor)

Add a parameter to this group

pub fn memory_usage(&self) -> usize

Get total memory usage of this group

Trait Implementations

impl Clone for ParameterGroup

fn clone(&self) -> ParameterGroup

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Debug for ParameterGroup

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.