Module distributed

Source
Expand description

Distributed training support for neural networks

Structs§

DistributedConfig
Distributed training configuration
DistributedManager
Distributed training manager
DistributedStats
Statistics for distributed training
InMemoryProcessGroup
In-memory process group for single-machine multi-process training
ProcessInfo
Process coordination information
TcpProcessGroup
TCP-based process group implementation

Enums§

CommunicationBackend
Communication backend for distributed training
DistributedStrategy
Distributed training strategy
GradientSyncMethod
Gradient synchronization method

Traits§

ProcessGroup
Process group trait for different communication backends