Expand description
I/O utilities for rustsim - Arrow batch building, CSV bridging, and ClickHouse writing.
This crate provides the data pipeline components:
ArrowBatchBuilder- incrementally builds ArrowRecordBatchvalues from typed rows.CollectArrowBridge- auto-flushing bridge that accumulates rows and produces batches at a configurable size.ClickHouseWriter- background writer that sends Arrow IPC batches to ClickHouse via HTTP with bounded-channel backpressure and exponential-backoff retry.
Modulesยง
- arrow
- Arrow batch building utilities.
- bridge
- Bridge between data collection and Arrow batch building.
- clickhouse
- ClickHouse writer with bounded-channel backpressure.
- prelude
- Re-exports of key I/O types.