faucet-sink-redshift 1.0.0

Amazon Redshift sink connector (COPY-from-S3 and multi-row INSERT) for the faucet-stream ecosystem
Documentation 
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24

#![cfg_attr(docsrs, feature(doc_cfg))]

//! # faucet-sink-redshift
//!
//! Amazon Redshift sink connector for the faucet-stream ecosystem.
//!
//! Two load paths, chosen by `write_strategy`:
//! - **`copy`** (default) — stage each page to S3 (JSONL or CSV) and bulk-load
//!   it with `COPY … FROM 's3://…' IAM_ROLE '…'`, then delete the staged object.
//!   Redshift's recommended, fastest bulk-load path.
//! - **`insert`** — multi-row `INSERT INTO … VALUES (…), (…)`. Portable and
//!   needs no S3, but slower for bulk data.
//!
//! Append-only: Redshift has no `ON CONFLICT` and `COPY` cannot upsert.

pub mod config;
pub mod copy;
pub mod sink;

pub use faucet_core::{FaucetError, Sink};

pub use config::{RedshiftCopyFormat, RedshiftSinkConfig, RedshiftWriteStrategy};
pub use faucet_common_redshift::{RedshiftConnection, RedshiftCredentials};
pub use sink::RedshiftSink;