Google BigQuery is a serverless and cost-effective enterprise data warehouse that works across clouds and scales with your data. Use built-in ML/AI and BI for insights at scale. BigQuery's serverless architecture lets you use SQL queries to analyze your data. You can store and analyze your data within BigQuery or use BigQuery to assess your data where it lives. 

Direct Integration with BigQuery

With the direct integration of Blueshift and BigQuery, importing customer data, catalogs, and real-time customer interaction data (events) into your Blueshift account is done easily and builds an up to date 360 degree view of all your customers.

After you have set up the integration, you can create a task to import customer data, catalogs, or events data into Blueshift.

Prerequisites

Before you can start with the integration, you must have the following:

• A Google Cloud Project with BigQuery enabled
• A Google Cloud Service Account with the "BigQuery User" and "BigQuery Data Editor" roles in your GCP project
• A Service Account Key to authenticate into your Service Account

Service Account

In order for Blueshift to sync data from BigQuery, it needs credentials for a Service Account with the "BigQuery User" and "BigQuery Data Editor" roles, which grants permissions to run BigQuery jobs, write to BigQuery Datasets, and read table metadata. We highly recommend that this Service Account is exclusive to Blueshift for ease of permissioning and auditing. However, you can use a pre-existing Service Account if you already have one with the correct permissions.

The easiest way to create a Service Account is to follow GCP's guide for Creating a Service Account.

Service Account Key

Service Account Keys are used to authenticate as Google Service Accounts. For Blueshift to leverage the permissions you granted to the Service Account in the previous step, you'll need to provide its Service Account Keys. See the Google documentation for more information about Keys.

Follow the Creating and Managing Service Account Keys guide to create a key. Blueshift supports JSON Keys only, so make sure you create your key in that format. As soon as you created the key, make sure to download it, as that is the only time Google will allow you to see its contents. Once you've successfully configured BigQuery as a source in Blueshift, delete this key from your computer.

Set up integration

To give Blueshift access to the data in BigQuery, complete the following steps:

1. Sign in to the Blueshift app, and click App Hub in the left navigation menu.
2. Go to All Apps, search for, and select BigQuery.
3. You can also go to Data Warehouse Apps and select BigQuery.
4. Click Configure to view all the configured adapters.
5. Click +ADAPTER to add an adapter.
   

   

6. Add a Name for the adapter. If you have multiple adapters, the adapter name helps you to identify the integration.
7. Provide the details of the data warehouse and the access token to access the data warehouse.
   

   Project ID	The GCP/BigQuery project from which you want to import data into Blueshift
   Default Dataset ID	The dataset within the project from which you want to import data
   Credential JSON	The Service Account key JSON that you would have downloaded as described in the prerequisites

8. Click Save.

 Next Steps

Create a task to import customer data, catalogs, or events data into Blueshift.