rustsim-io 0.0.1

Arrow batch builders, CSV bridge, and ClickHouse writer for rustsim
Documentation 
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26

//! I/O utilities for rustsim - Arrow batch building, CSV bridging, and ClickHouse writing.
//!
//! This crate provides the data pipeline components:
//!
//! - **[`ArrowBatchBuilder`](arrow::ArrowBatchBuilder)** - incrementally builds Arrow
//!   [`RecordBatch`](arrow_array::RecordBatch) values from typed rows.
//! - **[`CollectArrowBridge`](bridge::CollectArrowBridge)** - auto-flushing bridge that
//!   accumulates rows and produces batches at a configurable size.
//! - **[`ClickHouseWriter`](clickhouse::ClickHouseWriter)** - background writer that
//!   sends Arrow IPC batches to ClickHouse via HTTP with bounded-channel backpressure
//!   and exponential-backoff retry.

pub mod arrow;
pub mod bridge;
pub mod clickhouse;

/// Re-exports of key I/O types.
pub mod prelude {
    pub use crate::arrow::{
        schema_from_fields, ArrowBatchBuilder, ArrowValue, RecordBatchCollector,
    };
    pub use crate::bridge::{BridgeError, BridgeMetrics, CollectArrowBridge};
    pub use crate::clickhouse::{
        ClickHouseConfig, ClickHouseError, ClickHouseWriter, WriterMetricsSnapshot, WriterStats,
    };
}