Expand description
§Remote — Push/Pull Graph State Over Any Transport
§GRAPH MINDSET: NO FILES, NO SERIALIZATION TO DISK
Everything in this module operates on in-memory Arrow RecordBatches. When we “push” graph state, we convert Arrow tables to Parquet bytes in memory and send those bytes over the wire. When we “pull”, we receive bytes and load them directly into Arrow tables. At no point do we write to the filesystem. The graph store IS the data — Parquet is just the wire encoding, like protobuf but columnar.
§Wire Format
A length-prefixed JSON manifest followed by raw Parquet segments. The manifest contains commit history (JSON), ref pointers (JSON), and namespace segment offsets. Transport-agnostic — works over NATS, HTTP, TCP, or even carrier pigeon.
Structs§
- Snapshot
- A serialized snapshot of the full git state, ready for transport.
Enums§
- Remote
Error - Errors from remote operations.
Functions§
- bytes_
to_ snapshot - Deserialize a Snapshot from bytes received over NATS.
- restore_
snapshot - Restore git state from a Snapshot received over the wire.
- snapshot_
state - Serialize the current git state to a transportable Snapshot.
- snapshot_
to_ bytes - Serialize a Snapshot to a flat byte vector for NATS transport.