Skip to main content

Crate faucet_source_clickhouse

Crate faucet_source_clickhouse 

Source
Expand description

§faucet-source-clickhouse

ClickHouse query source for the faucet-stream ecosystem, built on the ClickHouse HTTP interface via reqwest.

Runs a SQL SELECT, streams the JSONEachRow response body straight into StreamPages (bytes are line-buffered and decoded incrementally, so memory stays bounded regardless of result size), and supports incremental replication via a tracking column (see ClickHouseReplication). Mirrors the faucet-source-postgres / mysql / mssql query sources.

let cfg = ClickHouseSourceConfig::new(
    "http://localhost:8123",
    "SELECT id, email, updated_at FROM events",
);
let source = ClickHouseSource::new(cfg)?;

Structs§

ClickHouseConnection
Shared connection configuration for the ClickHouse source and sink.
ClickHouseSource
ClickHouse query source (HTTP interface, JSONEachRow).
ClickHouseSourceConfig
Configuration for ClickHouseSource.

Enums§

ClickHouseReplication
How the source replicates rows across runs.