BigQuery

How to set up the BigQuery connection and additional notes on using it

With Codatum, you can connect, query, and manage data of BigQuery.

How to Set Up

Steps in BigQuery

First, perform the following operations in the BigQuery console:

• Generate a service account and service account key

• Grant the following roles or permissions to the target project:

  • Role BigQuery Job User or the following permissions:

    • bigquery.jobs.create

  • Role BigQuery Read Session User or the following permissions:

    • bigquery.readsessions.create

    • bigquery.readsessions.getData

    • bigquery.readsessions.update

  • Save the targetProject ID as it is necessary for the later steps in Codatum
• Grant the following roles or permissions to the target datasets:

  • Role BigQuery Data Viewer or the following permissions:

    • bigquery.tables.getData

    • bigquery.datasets.get

    • bigquery.tables.get

    • bigquery.tables.list

• (Optional) Grant the following permissions to the target project if you want to avoid entering the Project ID each time you sync the dataset table information

  • resourcemanager.projects.get

Steps in Codatum

Finally, create Connection in Codatum

1. In the Connection list, select New connection and select BigQuery

2. Enter a Connection name as the Display Name

3. Select the Access level

4. Upload the service account key using File upload

5. Enter the Project ID

   • Use the Project ID you saved in the steps above.

6. Add datasets to the Sync target

Use INFORMATION_SCHEMA for Searching

If you grant the bigquery.admin permission to the target project, you can utilize INFORMATION_SCHEMA tables to search any tables in non-synced datasets.