Crate faucet_source_delta 

faucet-source-delta

Apache Delta Lake source for the faucet-stream ecosystem. Streams the rows of a Delta table on the local filesystem or cloud object storage (S3 / Azure / GCS) via the Rust deltalake crate — reading the same open table format Databricks (and Spark, Trino, DuckDB, Microsoft Fabric) write.

• Native bounded stream_pages: the active file set is read from the Delta log and each parquet data file is streamed through the async Arrow reader (no whole-table buffering, no datafusion).
• Time travel via version or timestamp.
• Projection pushdown via columns; partition-column values are reconstructed from the Hive-style path and merged into every row.

Cloud backends are opt-in cargo features: s3, azure, gcs.

Structs

DeltaConnection

Location + credentials for a Delta table. Flattened (#[serde(flatten)]) into both the source and sink config so the same three keys appear at the connector-config top level.

DeltaSource

A source that reads an Apache Delta Lake table into JSON records.

DeltaSourceConfig

Configuration for the Delta Lake source connector.

Enums

DeltaCredentials

Object-store credentials for reading/writing a Delta table.