Delta Lake & Dagster#

Using Dagster's Software-defined Assets and Delta Lake I/O manager, you can easily interact with Delta Lake tables alongside other Dagster assets.

Managing your Delta tables with Dagster enables you to:

• Use Python to analyze your data stored in Delta Lake without writing custom SQL queries to fetch the data
• Visualize the data dependencies between tables
• Selectively update the contents of your tables
• Integrate your Delta tables with other tools in your data stack

Delta Lake and Dagster tutorial#

In this tutorial, you'll learn how to store and load Dagster's Software-defined Assets in a Delta Lake. Click here to get started.

By the end of the tutorial, you will have a connection to your Delta Lake and a handful of assets that create tables in a Deltalake or read existing tables from Deltalake.

References#