To interact with Google BigQuery® as part of a chain, add a step with a Google BigQuery connection command. For example:
- Load and query data in a tabular format
- Get metadata associated with your BigQuery projects and datasets
To enable these commands, an IT admin first creates a Google BigQuery connector.
Get dataset
To retrieve details about a BigQuery dataset, use a Get dataset command.
Properties
| Property |
Detail |
| Dataset ID |
Enter the ID of the dataset to query. |
Outputs
| Output |
Output type |
| Dataset JSON |
File |
Exit codes
| Code |
Type |
Error |
| 0 |
Success |
Success |
| 1 |
Error |
General failure |
Get model
To retrieve details about a BigQuery model, use a Get model command.
Properties
| Property |
Detail |
| Model ID |
Enter the ID of the model to query. |
| Dataset ID |
Enter the ID of the dataset that contains the model. |
Outputs
| Output |
Output type |
| Model JSON |
File |
Exit codes
| Code |
Type |
Error |
| 0 |
Success |
Success |
| 1 |
Error |
General failure |
Get routine
To retrieve details about a BigQuery routine, use a Get routine command.
Properties
| Property |
Detail |
| Routine ID |
Enter the ID of the routine to query. |
| Dataset ID |
Enter the ID of the dataset that contains the routine. |
Outputs
| Output |
Output type |
| Routine JSON |
File |
Exit codes
| Code |
Type |
Error |
| 0 |
Success |
Success |
| 1 |
Error |
General failure |
Get table
To retrieve details about a BigQuery table, use a Get table command.
Properties
| Property |
Detail |
| Table ID |
Enter the ID of the table to query. |
| Dataset ID |
Enter the ID of the dataset that contains the table. |
Outputs
| Output |
Output type |
| Table JSON |
File |
Exit codes
| Code |
Type |
Error |
| 0 |
Success |
Success |
| 1 |
Error |
General failure |
List datasets
To list all datasets for the BigQuery project, use a List datasets command.
Properties
None
Outputs
| Output |
Output type |
| Datasets JSON |
File |
Exit codes
| Code |
Type |
Error |
| 0 |
Success |
Success |
| 1 |
Error |
General failure |
List models
To list all models for a given dataset, use a List models command.
Properties
| Property |
Detail |
| Dataset ID |
Enter the ID of the dataset. |
Outputs
| Output |
Output type |
| Models JSON |
File |
Exit codes
| Code |
Type |
Error |
| 0 |
Success |
Success |
| 1 |
Error |
General failure |
List projects
To list all projects for the user, use a List projects command.
Properties
None
Outputs
| Output |
Output type |
| Projects JSON |
File |
Exit codes
| Code |
Type |
Error |
| 0 |
Success |
Success |
| 1 |
Error |
General failure |
List routines
To list all routines for given dataset, use a List routines command.
Properties
| Property |
Detail |
| Dataset ID |
Enter the ID of the dataset. |
Outputs
| Output |
Output type |
| Routines JSON |
File |
Exit codes
| Code |
Type |
Error |
| 0 |
Success |
Success |
| 1 |
Error |
General failure |
List table data
To retrieve all data in a given table in a tabular format, use a List table data command.
Properties
| Property |
Detail |
| Dataset ID |
Enter the ID of the dataset. |
| Table ID |
Enter the ID of the table to return data from. |
Outputs
| Output |
Output type |
| Table data CSV |
File |
Exit codes
| Code |
Type |
Error |
| 0 |
Success |
Success |
| 1 |
Error |
General failure |
List tables
To list all tables in a given dataset, use a List tables command.
Properties
| Property |
Detail |
| Dataset ID |
Enter the ID of the dataset. |
Outputs
| Output |
Output type |
| Tables JSON |
File |
Exit codes
| Code |
Type |
Error |
| 0 |
Success |
Success |
| 1 |
Error |
General failure |
Load data
To load tabular data into a given table, use a Load data command.
Properties
| Property |
Detail |
| Dataset ID |
Enter the ID of the dataset. |
| Table ID |
Enter the ID of the table to load data to. |
| File |
Enter the tabular data file to load to BigQuery. |
| Write mode |
Select how to load the data to the table:
- Overwrite—Replace the table's data with the file
- Append—Retain the table's data, and add the file at the end
- Safe Mode—Load the file only if the table is empty
|
| Schema |
To enter the schema for the File input, enter a JSON array with name, type, and mode fields. To have BigQuery automatically detect the schema, leave blank.
Note: To ensure the file's schema matches the table's, select the table in the left menu in BigQuery for the name, type, and mode of each field.
|
Outputs
| Output |
Output type |
| Rows processed |
Integer |
Exit codes
| Code |
Type |
Error |
| 0 |
Success |
Success |
| 1 |
Error |
General failure |
Query data
To extract data from BigQuery in a tabular format based on a query, use a Query data command.
Properties
| Property |
Detail |
| Dataset ID |
Enter the ID of the dataset. |
| Table ID |
Enter the ID of the table to extract data from. |
| Query |
Enter the query in BigQuery syntax. |
| Query location |
Enter the location of the data to query. For United States, leave blank. |
| Preview data |
To show a preview of the data returned from the query, check this box. |
Outputs
| Output |
Output type |
| Query output file |
File |
| Record count |
Integer |
Exit codes
| Code |
Type |
Error |
| 0 |
Success |
Success |
| 1 |
Error |
General failure |