Managed Google BigQuery
Please note that these instructions were made specifically for Rill Managed Pipelines and used by our data engineering team to set up orchestration from object stores/data warehouses into Rill Managed Database Services. While some of the concepts may apply, please refer to your providers documentation on the correct permissions required to connect to your service.
Setup instructions
Follow the instructions below to grant Rill access to your Google BigQuery datasets.
-
Find your Google Cloud Service Account by logging into Rill and clicking on Integrations. Your Google Cloud Service Account will be displayed. It will be of the form
organization
-workspace name
>@rilldata.iam.gserviceaccount.com. -
Go to your Google Cloud Console and select the project to which you want to grant access.
-
Open the sidebar menu by clicking the 3 lines button in the top left, then choose IAM & Admin then click on IAM https://console.cloud.google.com/iam-admin/iam
-
In the IAM menu click the ADD button. This will display a form where you can input the service accounts that can access your project and the permissions with which they can access it.
-
In the New members field, enter your google service account, found in step 1.
-
Select the role
BigQuery Data Viewer
,BigQuery Read Session User
, andBigQuery Job User
. This will permit Rill to fetch your projects tables into BigQuery.
- Click on save.