Beam BigQuery Input

Beam BigQuery Input

Description

The Beam BigQuery Input transform can be used to input data from Google Cloud BigQuery using the Beam execution engine.

Hop Engine	✓
Spark	✓
Flink	✓
Dataflow	✓

Options

Option	Description
Transform name	Name of the transform, this name has to be unique in a single pipeline.
Project ID	The Google Cloud project.
Data set ID	The BigQuery dataset ID.
Table ID	The BigQuery table ID.
Query	The input query, blank means everything from the table.
Return fields selection	A list of result fields.
BQ Field name	The field name in the BigQuery table.
Rename to…​ (optional)	The name to be given to a column.
Hop data type	The field data type.