Skip to main content

Crate rustsim_io

Crate rustsim_io 

Source
Expand description

I/O utilities for rustsim - Arrow batch building, CSV bridging, and ClickHouse writing.

This crate provides the data pipeline components:

  • ArrowBatchBuilder - incrementally builds Arrow RecordBatch values from typed rows.
  • CollectArrowBridge - auto-flushing bridge that accumulates rows and produces batches at a configurable size.
  • ClickHouseWriter - background writer that sends Arrow IPC batches to ClickHouse via HTTP with bounded-channel backpressure and exponential-backoff retry.

Modulesยง

arrow
Arrow batch building utilities.
bridge
Bridge between data collection and Arrow batch building.
clickhouse
ClickHouse writer with bounded-channel backpressure.
prelude
Re-exports of key I/O types.