Tutorial#

If you're new to Dagster, we recommend working through this tutorial to become familiar with Dagster's feature set and tooling, using small examples that are intended to be illustrative of real data problems.

Intro Tutorial#

The tutorial is divided into several sections:

• Setup for the Tutorial has instructions for installing Dagster.
• A Single-Solid Pipeline explains Dagster's core concepts and shows how to execute a single-step pipeline.
• Connecting Solids in Pipelines shows how to build pipelines with multiple solids.
• Testing Solids and Pipelines shows how to write unit-tests for solids and pipelines.

Advanced Tutorials#

These sections will introduce some advanced features and give you deeper insight into Dagster.

• Configuring Solids shows how to parameterize pipelines with configuration.
• Dagster Types covers Dagster's type system.
• Modes, Resources, & Presets demonstrates how to hold your business logic constant while interacting with external services in different environments.
• Materializations demonstrates a way to make Dagster aware of your persistent artifacts outside the system.
• Organizing Pipelines in Repositories & Workspaces demonstrates constructs that are useful when you have many pipelines that you need to organize.
• Scheduling Pipeline Runs will show you how to schedule pipelines to run at regular intervals using cron.