Dagster integration with dbt
In this example, you'll build a pipeline with Dagster that integrates with dbt, including incremental models and tests.
Prerequisites
To follow the steps in this guide, you'll need:
- Basic Python knowledge
- Python 3.9+ installed on your system. Refer to the Installation guide for information.
- Familiar with dbt and data transformation.
1. Set up your Dagster environment
First, set up a new Dagster project.
-
Clone the Dagster repo and navigate to the project:
cd examples/docs_projects/project_dbt
-
Install the required dependencies with
uv
:uv sync
-
Activate the virtual environment:
- MacOS
- Windows
source .venv/bin/activate
.venv\Scripts\activate
-
Ensure the following environments have been populated in your
.env
file. Start by copying the template:cp .env.example .env
And then populate the fields.
2. Launch the Dagster webserver
To make sure Dagster and its dependencies were installed correctly, navigate to the project root directory and start the Dagster webserver:
dg dev
Next steps
Continue this example with the ingestion step.