Crate faucet_sink_databricks 

faucet-sink-databricks

Databricks SQL warehouse sink for the faucet-stream ecosystem. Loads pages into a Delta table through a SQL warehouse’s Statement Execution API (plain REST — no JDBC/ODBC driver):

• Load paths — a multi-row INSERT … FROM VALUES for small pages, or a staged all-string Parquet file (Unity Catalog volume via the Files API, or S3 / GCS / ADLS behind the staging feature) loaded with COPY INTO. Every value is cast to the column’s declared type on the server.
• Write modes — append, upsert / delete via one MERGE per statement (with delete_marker), and overwrite via a staging table and an atomic INSERT OVERWRITE swap.
• Exactly-once — a _faucet_commit_token watermark table plus a data write that is idempotent per page token (INSERT … REPLACE WHERE for append, MERGE for upsert), so a replayed page never duplicates.
• Schema — current_schema from information_schema.columns, ALTER TABLE ADD COLUMNS / Delta type widening for drift, and table auto-create from the first page.

Structs

DatabricksSink

Databricks SQL warehouse sink.

DatabricksSinkConfig

Configuration for the Databricks SQL warehouse sink.

DatabricksStagingConfig

Where staged Parquet files are written before the warehouse loads them.

Enums

DatabricksAuth

Authentication for the Databricks SQL Statement Execution API.

DatabricksLoadMethod

How a page is loaded into the table.

Constants

DESCRIPTOR

The connector’s static descriptor (RFC 0013): its capabilities, answered from config alone.

STATEMENT_TEXT_LIMIT

Hard ceiling on one Statement Execution API request’s statement text.