Skip to main content

Module stream

Module stream 

Source
Expand description

BigQuery query source.

Submits the configured SQL statement via jobs.query and pages through the result set via jobs.getQueryResults. The first response may carry jobComplete=false (statement still running on the server side); the source polls getQueryResults until BigQuery flips that flag, exactly mirroring the behaviour of gcp_bigquery_client::Client::job().query_all without giving up the row-level access we need for incremental StreamPages.

Structsยง

BigQuerySource
A source that runs a SQL query against BigQuery and yields rows as JSON.