Enum GradientSyncMethod

pub enum GradientSyncMethod {
    AllReduce,
    ParameterServer,
    RingAllReduce,
    TreeAllReduce,
    HierarchicalAllReduce,
}

Gradient synchronization method

Variants

AllReduce

All-reduce - everyone gets the same result

ParameterServer

Parameter server - centralized parameter updates

RingAllReduce

Ring all-reduce - bandwidth-optimal for large clusters

TreeAllReduce

Tree all-reduce - latency-optimal for small clusters

HierarchicalAllReduce

Hierarchical all-reduce - multi-level reduction

Trait Implementations

impl Clone for GradientSyncMethod

fn clone(&self) -> GradientSyncMethod

Returns a duplicate of the value.

const fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Debug for GradientSyncMethod

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl<'de> Deserialize<'de> for GradientSyncMethod

fn deserialize<__D>(__deserializer: __D) -> Result<Self, __D::Error>

where __D: Deserializer<'de>,

Deserialize this value from the given Serde deserializer.

impl PartialEq for GradientSyncMethod

fn eq(&self, other: &GradientSyncMethod) -> bool

Tests for self and other values to be equal, and is used by ==.

const fn ne(&self, other: &Rhs) -> bool

Tests for !=. The default implementation is almost always sufficient, and should not be overridden without very good reason.

impl Serialize for GradientSyncMethod

fn serialize<__S>(&self, __serializer: __S) -> Result<__S::Ok, __S::Error>

where __S: Serializer,

Serialize this value into the given Serde serializer.

impl Copy for GradientSyncMethod

impl Eq for GradientSyncMethod

impl StructuralPartialEq for GradientSyncMethod