Transform data
A data platform typically involves people in various roles working together, each contributing in different ways. Some individuals will be more involved in certain areas than others. For example, with dbt, analysts may focus primarily on modeling the data, but still want their models integrated into the overall pipeline.
In this step, we will incorporate a dbt project to model the data we loaded with DuckDB.
1. Add the dbt project
First we will need a dbt project to work with. Run the following to add a dbt project to the root of the etl_tutorial
:
git clone --depth=1 https://github.com/dagster-io/jaffle-platform.git transform && rm -rf transform/.git
There will now be a directory transform
within the root of the project containing our dbt project.
.