Skip to main content

Module remote

Module remote 

Source
Expand description

§Remote — Push/Pull Graph State Over Any Transport

§GRAPH MINDSET: NO FILES, NO SERIALIZATION TO DISK

Everything in this module operates on in-memory Arrow RecordBatches. When we “push” graph state, we convert Arrow tables to Parquet bytes in memory and send those bytes over the wire. When we “pull”, we receive bytes and load them directly into Arrow tables. At no point do we write to the filesystem. The graph store IS the data — Parquet is just the wire encoding, like protobuf but columnar.

§Wire Format

A length-prefixed JSON manifest followed by raw Parquet segments. The manifest contains commit history (JSON), ref pointers (JSON), and namespace segment offsets. Transport-agnostic — works over NATS, HTTP, TCP, or even carrier pigeon.

Structs§

Snapshot
A serialized snapshot of the full git state, ready for transport.

Enums§

RemoteError
Errors from remote operations.

Functions§

bytes_to_snapshot
Deserialize a Snapshot from bytes received over NATS.
restore_snapshot
Restore git state from a Snapshot received over the wire.
snapshot_state
Serialize the current git state to a transportable Snapshot.
snapshot_to_bytes
Serialize a Snapshot to a flat byte vector for NATS transport.