Module multi_gpu 

Structs

AdaptiveCommunicationSelector

Adaptive communication strategy selector

CommunicationPerformanceMonitor

Communication performance monitoring

CommunicationPerformanceStats

Communication performance statistics snapshot

MultiGpuConfig

Multi-GPU configuration

MultiGpuSetup

Helper to setup multi-GPU training

MultiGpuSync

Multi-GPU synchronization manager

Enums

SyncStrategy

Multi-GPU synchronization strategy