Set up a warehouse
In order to connect to your data warehouse to run your project's compiled SQL on your behalf, Dataform requires some warehouse access details.
Configuring your data warehouse settings should take less than 5 minutes. If you encounter any difficulty, please contact our team using Intercom or via email at firstname.lastname@example.org.
Create a service account
You’ll need to create a service account from your Google Cloud Console and assign it permissions to access BigQuery.
- Follow these instructions to create a new service account in Google Cloud Console.
- Grant the new account the
BigQuery Adminrole. (Admin access is required by Dataform so that it can create queries and list tables.) Read this if you need help.
- Create a key for your new service account (in JSON format). You will upload this file to Dataform. Read this if you need help.
Postgres (running in AWS) or Redshift
Postgres and Redshift projects require the following configuration settings:
- Hostname in the form
- Port (usually
5432for Postgres or
- Username and password
- Database name
How to find Redshift credentials
- Go to
Redshiftin your AWS console.
- Select your cluster under
- The hostname is the endpoint listed at the top of the page. Username and database name are listed under cluster database properties. You may prefer to create a separate username and password for Dataform to use - please contact our team if you need help.
Snowflake connections require the following elements:
- Account name: the first part of your Snowflake url, including region:
- Username and password used for your Snowflake console. You may prefer to create a separate username and password for Dataform to use - please contact our team if you need help.
- Warehouse name: Click "Warehouses" from within your Snowflake console to view a list of warehouses. Any warehouse in your account will work with any database.
- Database: Click "Databases" from within your Snowflake console to view a list of databases.
You may also need to whitelist Dataform's IP addresses: