Skip to main content

module_parameter_group

Function module_parameter_group 

Source
pub fn module_parameter_group<T, M>(
    logical_name: impl Into<String>,
    role: ParameterRole,
    module: &M,
    sharding: impl FnMut(&ParameterMetadata, &[usize]) -> Result<MemberSharding, ParallelPlanError>,
) -> Result<ParameterGroupSpec, ParallelPlanError>
where T: Tensor, M: Parameterized<T>,
Expand description

Describes every parameter in a neutral module as one logical group.