Dataform uses the Git version control system to maintain a record of each change made to project files and to manage file versions. Each Dataform project has an associated Git repository.
When you first use Dataform we will automatically create a personal development branch for you called
name_dev . Only you can see this branch and commit to it. All the changes you've made so far should be on this branch.
Comitt Changes button:
Give your commits a description and press
Push to Master button to push your changes to the master branch:
productionand used for future schedule runs.
For more information on how version control works in Dataform, see our docs.
You’ve now created your two tables;
order stats and
customers depends on
order_stats and will not be run until
order_stats is updated. You have added data quality tests so that you know the data is reliable and you have documented your datasets so other team members know what the tables contain. A schedule will run every hour to keep the tables up to date, and you will be automatically alerted if the pipeline fails or there are data quality issues.
Follow the steps in this tutorial to get started with your own project. Connect to your own warehouse and create your first dataset using SQL.