Struct GradientArrowBlock 

pub struct GradientArrowBlock {
    pub cid: String,
    pub layer_name: String,
    pub shape: Vec<usize>,
    pub values: Vec<f32>,
    pub num_samples: usize,
}

A gradient stored as an Arrow IPC block with content-addressing.

Fields

cid: String

layer_name: String

shape: Vec<usize>

values: Vec<f32>

num_samples: usize

Implementations

impl GradientArrowBlock

pub fn to_arrow_bytes(&self) -> Vec<u8>

Serialize gradient values to custom Arrow-flavoured IPC bytes.

Layout:

4  bytes  magic "GARW"
4  bytes  shape_len  (u32 LE)
4n bytes  shape      (u32 LE each)
4  bytes  values_len (u32 LE)
4m bytes  values     (f32 LE each)
4  bytes  num_samples (u32 LE)

pub fn from_arrow_bytes( cid: String, layer_name: String, data: &[u8], ) -> Result<Self, ArrowBlockError>

Deserialize from bytes produced by Self::to_arrow_bytes.

pub fn compute_cid( layer_name: &str, values: &[f32], num_samples: usize, ) -> String

Compute a deterministic CID string: "grad-" + hex(FNV-1a hash of serialized bytes).

pub fn fedavg( blocks: &[GradientArrowBlock], ) -> Result<Vec<f32>, ArrowBlockError>

FedAvg: weighted average of multiple gradient blocks.

Weights are proportional to num_samples. All blocks must have the same shape. Returns ArrowBlockError::EmptyInput for empty input and ArrowBlockError::ShapeMismatch if shapes differ.