Beam BigQuery Output

Beam BigQuery Output

Description

The Beam BigQuery Output transform can be used to write data to a BigQuery table using the Beam execution engine.

Hop Engine	X
Spark	✓
Flink	✓
Dataflow	✓

Options

Option	Description
Transform name	Name of the transform, this name has to be unique in a single pipeline.
Project ID	The Google Cloud Platform project.
Data set ID	The BigQuery dataset ID.
Table ID	The BigQuery table ID.
Create table if needed	Whether or not to create the table if it does not exist. (default: true)
Truncate table	Whether or not to truncate the table before inserting.
Fail if the table is not empty	Throws an error if the table is not empty.