Enum CompressionMethod 

pub enum CompressionMethod {
    TopK {
        k: usize,
    },
    RandomK {
        k: usize,
    },
    Threshold {
        threshold: f32,
    },
    Quantization {
        bits: u8,
    },
    SignSGD,
    ErrorFeedback {
        base_method: Box<CompressionMethod>,
    },
}

Gradient compression algorithms for distributed training.

Reduces communication overhead by compressing gradients before sending them across the network in distributed training setups.

Variants

TopK

Top-K sparsification: only send the K largest gradients

Fields

k: usize

RandomK

Random-K sparsification: randomly sample K gradients

Fields

k: usize

Threshold

Threshold-based sparsification: send gradients above threshold

Fields

threshold: f32

Quantization

Quantization-based compression

Fields

bits: u8

SignSGD

SignSGD: send only the sign of gradients

ErrorFeedback

Error feedback compression

Fields

base_method: Box<CompressionMethod>

Trait Implementations

impl Clone for CompressionMethod

fn clone(&self) -> CompressionMethod

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Debug for CompressionMethod

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.