Struct MultiGpuConfig 

pub struct MultiGpuConfig {
    pub num_gpus: usize,
    pub rank: usize,
    pub sync_strategy: SyncStrategy,
    pub gradient_compression: bool,
    pub compression_ratio: f32,
    pub local_group_size: usize,
    pub adaptive_communication: bool,
    pub bandwidth_monitor_interval: usize,
    pub async_param_updates: bool,
    pub communication_timeout_ms: u64,
    pub error_correction: bool,
    pub pipeline_depth: usize,
}

Multi-GPU configuration

Fields

num_gpus: usize

Number of GPUs

rank: usize

GPU rank (0-indexed)

sync_strategy: SyncStrategy

Synchronization strategy

gradient_compression: bool

Enable gradient compression

compression_ratio: f32

Compression ratio (for top-k compression)

local_group_size: usize

Local GPU group size (for hierarchical)

adaptive_communication: bool

Enable adaptive communication optimization

bandwidth_monitor_interval: usize

Bandwidth monitoring interval (steps)

async_param_updates: bool

Enable asynchronous parameter updates

communication_timeout_ms: u64

Communication timeout (milliseconds)

error_correction: bool

Enable error correction for communication

pipeline_depth: usize

Pipeline depth for overlapping computation and communication

Implementations

impl MultiGpuConfig

pub fn validate(&self) -> Result<(), GpuOptimError>

Check every field that is later used as a divisor or an index bound, so a bad config fails here with a clear message instead of panicking (division by zero) deep inside a sync call.

Trait Implementations

impl Clone for MultiGpuConfig

fn clone(&self) -> MultiGpuConfig

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Debug for MultiGpuConfig

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl Default for MultiGpuConfig

fn default() -> Self

Returns the “default value” for a type.