Tutorial#

If you're new to Dagster, we recommend working through this tutorial to become familiar with Dagster's feature set and tooling, using small examples that are intended to be illustrative of real data problems.

Intro Tutorial#

The tutorial is divided into several sections:

• Setup for the Tutorial has instructions for installing Dagster.
• A Single-Op Job explains Dagster's core concepts and shows how to execute a single-step job.
• Connecting Ops in Job shows how to build jobs with multiple ops.
• Testing Ops and Jobs shows how to write unit-tests for ops and jobs.

Advanced Tutorials#

These sections will introduce some advanced features and give you deeper insight into Dagster.

• Configuring Ops shows how to parameterize pipelines with configuration.
• Dagster Types covers Dagster's type system.
• Resources & Built-In Config demonstrates how to hold your business logic constant while interacting with external services in different environments.
• Materializations demonstrates a way to make Dagster aware of your persistent artifacts outside the system.
• Organizing Jobs in Repositories & Workspaces demonstrates constructs that are useful when you have many jobs that you need to organize.
• Scheduling Job Runs will show you how to schedule jobs to run at regular intervals using cron.