Dagster & SLURM

Community integration

This is a community-maintained integration. To report bugs or leave feedback, open an issue in the Dagster community integrations repo.

The SLURM integration allows you to easily interact with the SLURM workload manager on HPC systems using the SLURM CLI to scale your workload of your Dagster pipelines.

Installation

uv

uv add dagster-slurm

pip

pip install dagster-slurm

Example

• Get a quick overview here https://dagster-slurm.geoheil.com/docs/slides
• Read more: https://georgheiler.com/post/dagster-slurm/
• See the docs for detailed instructions https://dagster-slurm.geoheil.com/

About ASCII

ASCII is a research institute about supply chains. We work with very large unstructured datasets and extract insights.

The research institute is dedicated to providing analyses to better address future challenges related to value networks, strategic interdependencies, and ensuring production and supply security. The aim is to provide decision-makers in politics, administration and industry with a solid basis for achieving the Austrian and European goals of secure value creation and environmental neutrality.