Expand description
§faucet-source-databricks
Databricks SQL query source for the faucet-stream
ecosystem. Runs a SQL statement against a Databricks SQL Warehouse via
the Statement Execution API
(plain REST — no JDBC/ODBC driver) and streams the result rows as typed
JSON objects.
This is the query-results read path for Databricks (joins / aggregates /
filtered extracts). For full-table lakehouse scans and the write path, use
the Delta Lake connectors (faucet-source-delta / faucet-sink-delta).
- Async statement lifecycle: submit → poll until terminal → stream result
chunks (INLINE +
JSON_ARRAY), followingnext_chunk_internal_link. - Type-aware decode from the response
manifestcolumn schema. - Incremental replication via a bookmark column + a
${bookmark}token (server-side named param) plus a client-side filter backstop. - Bearer auth (PAT / OAuth M2M), inline or via the shared
auth:catalog.
Structs§
- Databricks
Param - A named SQL parameter passed to the statement (
:namemarkers in the SQL). - Databricks
Source - Databricks SQL query source.
- Databricks
Source Config - Configuration for the Databricks SQL query source.
Enums§
- Databricks
Auth - Authentication for the Databricks SQL Statement Execution API.
- Databricks
Replication - How the source replicates rows across runs.