Snowflake

Authentification

Snowflake connections require the following elements:

• Account name: the first part of your Snowflake url, including region: account-name.region .snowflakecomputing.com
• Username and password used for your Snowflake console. You may prefer to create a separate username and password for Dataform to use - you can read more about creating users here.
• Warehouse name: Click "Warehouses" from within your Snowflake console to view a list of warehouses. This warehouse will be used when Dataform creates runs in Snowflake.
• Database: Click "Databases" from within your Snowflake console to view a list of databases.

Configuration options

Querying different databases

You can both read from and publish to two separate snowflake databases within a single Dataform project. For example, you may have a database called RAW_SOURCE that contains raw data loaded into Snowflake and a database called ANALYTICS in which you create data tables you use for analytics and reporting.

You can define a default database in your dataform.json file.

1{
2    "warehouse": "snowflake",
3    "defaultSchema": "dataform",
4    "assertionSchema": "dataform_assertions",
5    "defaultDatabase": "ANALYTICS"
6}

You can then override the default database in the config block of your SQLX files.

1config {
2    type: "table",
3    database: “RAW_SOURCE”
4}

Using separate databases for development and production

You can configure separate databases for development and production in your environment.json file. The process is described on this page.

Dataform web features for Snowflake

Real time query validation

Dataform validates the compiled script you are editing against Snowflake in real time. It will let you know if the query is valid (or won’t run) before having to run it.

Sample Dataform project with Snowflake

We prepared the following sample project of a fictional ecommerce store using using Snowflake.

View project page

Getting help

If you are using Dataform web and are having trouble connecting to Snowflake, please reach out to us by using the intercom messenger icon at the bottom right of the app.

If you have other questions related to Snowflake, you can join our slack community and ask question on the #Snowflake channel.

Join dataform-users on slack

Sitemap