Skip to main content

Module arrow_ipc

Module arrow_ipc 

Source
Expand description

Standalone Arrow IPC helpers for gradient serialization.

These functions serialize/deserialize raw f32 gradient slices to/from Apache Arrow IPC format so that gradients can be stored as content-addressed blocks in the IPFS block store.

Functionsยง

load_gradient_from_arrow
Deserialize gradient from Arrow IPC bytes produced by store_gradient_as_arrow.
store_gradient_as_arrow
Serialize a gradient tensor as an Arrow IPC RecordBatch.