- 18 Aug 2021
- 1 Minute to read
- Print
- DarkLight
- PDF
Connecting a BigQuery Warehouse
- Updated on 18 Aug 2021
- 1 Minute to read
- Print
- DarkLight
- PDF
Google BigQuery
Connecting Precog
- In the Panoply navigation menu, click BI Connection. This displays your Panoply data warehouse's connection details.
- Download the .json credentials file.
- Sign into your Precog account.
- Click the Destinations
- Search for Panoply BigQuery
- Click the Panoply icon.
- Name the destination.
- Enter the dataset you wish to send the data to.
- Upload the .json file you downloaded in step 2.
- Click on Add.
- Select which tables you wish to connect to this destination.
Connecting Stitch
- In the Panoply navigation menu, click BI Connection. This displays your Panoply data warehouse's connection details.
- Download the .json credentials file.
- Sign into your Stitch account.
- Click the Destination tab.
- Click the Google BigQuery icon.
- Scroll to the Your service account section.
- In the Your Key File field, click the icon and locate the JSON credentials file you downloaded in Step 3. Once uploaded, the BigQuery Project Name field will automatically populate with the name of the GCP project in the JSON project key file.
- Select a Google Storage Location by using the Google Cloud Storage Location dropdown, then select a US region.
Changing this setting will result in replication issues if data migration isn’t completed correctly.
9. There are two definitions for the loading behavior:
* Upsert: Existing rows will be updated with the most recent version of the record from the source. With this option, only the most recent version of a record will exist in Google BigQuery.
* Append: Existing rows aren’t updated. Newer versions of existing records are added as new rows to the end of tables. With this option, many versions of the record will exist in Google BigQuery, capturing how a record changed over time.
- Refer to the Understanding loading behavior guide for more info and examples.
Loading behavior can’t be changed after the destination is created. To change Google BigQuery loading behavior, you’ll need to delete and re-create the destination.
This setting may impact your Google BigQuery costs. Learn more.
10. Click Check and Save. Stitch will perform a connection test to the Google BigQuery database; if successful, a Success message will display at the top of the screen. This test may take a few minutes to complete.