Enum CommunicationStrategy 

pub enum CommunicationStrategy {
    AllReduce {
        algorithm: AllReduceAlgorithm,
        compression: bool,
    },
    ParameterServer {
        num_servers: usize,
        update_frequency: usize,
    },
    Gossip {
        neighbors: usize,
        gossip_frequency: usize,
    },
    Hierarchical {
        local_groups: usize,
        inter_group_strategy: Box<CommunicationStrategy>,
    },
}

Communication strategies for distributed training

Variants

AllReduce

All-reduce communication

Fields

algorithm: AllReduceAlgorithm

All-reduce algorithm

compression: bool

Enable gradient compression

ParameterServer

Parameter server architecture

Fields

num_servers: usize

Number of parameter servers

update_frequency: usize

Update frequency

Gossip

Gossip protocols

Fields

neighbors: usize

Number of neighbors

gossip_frequency: usize

Gossip communication frequency

Hierarchical

Hierarchical communication

Fields

local_groups: usize

Number of local groups

inter_group_strategy: Box<CommunicationStrategy>

Inter-group communication strategy

Trait Implementations

impl Clone for CommunicationStrategy

fn clone(&self) -> CommunicationStrategy

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Debug for CommunicationStrategy

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.