With the Google® BigQuery® connector, you can use commands in a chain to interact with a BigQuery project. For example, with this connector, you can:
- Load and query data in BigQuery tables
- Retrieve metadata about BigQuery datasets, models, routines, and tables
- List datasets, models, routines, and tables in BigQuery
Prerequisites
To set up the connector, you'll need:
- The ID of the BigQuery project to connect to
Note: In BigQuery, the project's ID appears in the Project selector.
- A designated project service account set up for the connector
- The service account's private key JSON file
Create a Google service account for the connector
To enable the connection, create a service account in the BigQuery project for the connector to use, and download its private key file:
- From Service Accounts in Google Cloud Platform, select Select Project, and open the BigQuery project to connect to.
- Click Create Service Account.
- Enter a unique name and description to help identify the service account, and click Create.
- For Role, select Project, Owner, and click Continue and then Done.
- Under Service Accounts, select Actions, Create key for the new account.
- Under Key type, select JSON, and click Create.
Set up the Google BigQuery connector
Note: To make the connector available for use in your organization's chains, an org security administrator first enables it from Configuration.
- From Chain Builder, click Connections , and then Create at the top right.
- Under BizApp Connection, select Google BigQuery and the default CloudRunner.
- Under Basic Info, enter a unique name and description to help identify the connector.
- Under Resources, upload the private key JSON file for the connector's service account.
- Under Properties, enter the connection's details:
Property Details Project ID Enter the ID of the BigQuery project to connect to. Note: In BigQuery, the project's ID appears in the Project selector.
Credentials file Enter the name of the private key JSON file uploaded under Resources. Note: All sensitive credentials are automatically encrypted and stored at Advanced Encryption Standard (AES)-256 encryption.
- Select the environments to use the connection, and click Save.
- To test the connection, create and run a chain with the connector's List Datasets command, and verify it returns a valid output.
Troubleshooting
If the connection to Google BigQuery fails:
- Verify the project's ID. In BigQuery, the ID appears in the Project selector.
- Check the filename of the private key for the connector's service account. If necessary, create a new service account for the connector in Google Cloud Platform, and use its private key as the connector's credentials file.