Skip to main content

Module stream

Module stream 

Source
Available on crate features source-bigquery and source-rest only.
Expand description

BigQuery query source.

Submits the configured SQL statement via jobs.query and pages through the result set via jobs.getQueryResults. The first response may carry jobComplete=false (statement still running on the server side); the source polls getQueryResults until BigQuery flips that flag, exactly mirroring the behaviour of gcp_bigquery_client::Client::job().query_all without giving up the row-level access we need for incremental StreamPages.

Structsยง

BigQuerySource
A source that runs a SQL query against BigQuery and yields rows as JSON.