Enum CompressionStrategy 

pub enum CompressionStrategy {
    None,
    TopK {
        k: usize,
    },
    RandomK {
        k: usize,
    },
    Threshold {
        threshold: f64,
    },
    Quantization {
        bits: u8,
    },
    ErrorFeedback {
        base_strategy: Box<CompressionStrategy>,
        error_compensation: bool,
    },
    ClippedCompression {
        base_strategy: Box<CompressionStrategy>,
        clip_value: f64,
    },
}

Gradient compression strategies for communication optimization

Variants

None

No compression

TopK

Top-K sparsification (keep only top K largest gradients)

Fields

k: usize

Number of top gradients to keep

RandomK

Random-K sparsification (keep K random gradients)

Fields

k: usize

Number of random gradients to keep

Threshold

Threshold-based sparsification (keep gradients above threshold)

Fields

threshold: f64

Threshold value for gradient magnitude

Quantization

Quantization to fewer bits

Fields

bits: u8

Number of bits for quantization

ErrorFeedback

Error feedback compression (maintain error state)

Fields

base_strategy: Box<CompressionStrategy>

Base compression strategy to apply

error_compensation: bool

Whether to enable error compensation

ClippedCompression

Gradient clipping before compression

Fields

base_strategy: Box<CompressionStrategy>

Base compression strategy to apply after clipping

clip_value: f64

Value to clip gradients to

Trait Implementations

impl Clone for CompressionStrategy

fn clone(&self) -> CompressionStrategy

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Debug for CompressionStrategy

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl PartialEq for CompressionStrategy

fn eq(&self, other: &CompressionStrategy) -> bool

Tests for self and other values to be equal, and is used by ==.

fn ne(&self, other: &Rhs) -> bool

Tests for !=. The default implementation is almost always sufficient, and should not be overridden without very good reason.

impl StructuralPartialEq for CompressionStrategy