Libraries
You can integrate Dagster with external services or non-Python languages using our libraries and libraries supported by the community.
Airbyte
2 items
Airlift
Easily integrate Dagster and Airflow.
Anthropic
Integrate Anthropic calls into your Dagster pipelines, without breaking the bank.
AWS
10 items
Azure Data Lake Storage Gen 2
Get utilities for ADLS2 and Blob Storage.
Census
Community / Partner supported
Trigger Census synchs from within your Dagster pipelines.
Chroma
Integrate Chroma vector database capabilities into your AI pipelines powered by Dagster.
Cube
Community / Partner supported
Push changes from upstream data sources to Cubes semantic layer.
Databricks
The Databricks integration enables you to initiate Databricks jobs directly from Dagster, seamlessly pass parameters to your code, and stream logs and structured messages back into Dagster.
Datadog
Publish metrics to Datadog from within Dagster ops and entralize your monitoring metrics.
dbt
6 items
Delta Lake
2 items
DingTalk
Community / Partner supported
The community-supported `dagster-dingtalk` package provides an integration with DingTalk.
dlt
Easily ingest and replicate data between systems with dlt through Dagster.
Docker
Run runs external processes in docker containers directly from Dagster.
DuckDB
2 items
Embedded ELT
Build ELT pipelines with Dagster through helpful asset decorators and resources
Evidence
Build robust dashboards with markdown and SQL using the Evidence integration
Fivetran
Orchestrate Fivetran connectors syncs with upstream or downstream dependencies.
GCP
4 items
Gemini
Integrate Gemini calls into your Dagster pipelines, without breaking the bank.
GitHub
Integrate with GitHub Apps and automate operations within your github repositories.
HashiCorp Nomad
Community / Partner supported
The community-supported `dagster-nomad` package provides an integration with HashiCorp Nomad.
HashiCorp Vault
Community / Partner supported
Centrally manage credentials and certificates, then use them in your pipelines.
Hex
Community / Partner supported
The community-supported `dagster-hex` package provides an integration with Hex.
Hightouch
Community / Partner supported
Trigger syncs and monitor them until they complete.
Libraries
You can integrate Dagster with external services or non-Python languages using our libraries and libraries supported by the community.
Java
The Java Pipes client provides a Java implementation of the Dagster Pipes protocol that can be used to orchestrate data processing pipelines written in Java from Dagster, while receiving logs and metadata from the Java application.
Jupyter Notebooks
2 items
Kubernetes
Launch Kubernetes pods and execute external code directly from Dagster.
LakeFS
Community / Partner supported
lakeFS provides version control and complete lineage over the data lake.
Looker
The Looker integration allows you to monitor your Looker project as assets in Dagster, along with other data assets.
Meltano
Community / Partner supported
Tap into open source configurable ETL+ and the Singer integration library.
Microsoft Teams
Keep your team up to speed with Teams messages.
Modal
Community / Partner supported
The community-supported `dagster-modal` package provides an integration with Modal.
MSSQL Bulk Copy Tool
The community-supported `dagster-mssql-bcp` package is a custom Dagster I/O manager for loading data into SQL Server using the bcp utility.
Not Diamond
Community / Partner supported
Integration with the LLM model routing platform Not Diamond
obstore
Community / Partner supported
The community-supported `dagster-obstore` package provides an integration with obstore.
Open Metadata
Community / Partner supported
Configure and schedule Dagster metadata and profiler workflows from the OpenMetadata UI.
OpenAI
Integrate OpenAI calls into your Dagster pipelines, without breaking the bank.
PagerDuty
Centralize your monitoring with the dagster-pagerduty integration.
Pandas
Implement validation on pandas DataFrames.
Pandera
Generate Dagster Types from Pandera dataframe schemas.
Patito
Patito is a data validation framework for Polars, based on Pydantic.
Perian
Community / Partner supported
The `dagster-perian` integration allows you to easily dockerize your codebase and execute it on the PERIAN platform, PERIAN's serverless GPU environment.
Polars
Polars is a blazingly fast DataFrame library written in Rust with bindings for Python.
Power BI
Represent your Power BI assets in Dagster.
Prometheus
Integrate with Prometheus via the prometheus_client library.
Qdrant
Integrate Qdrant vector search features into your workflows powered by Dagster.
Ray
Community / Partner supported
The community-supported `dagster-ray` package allows orchestrating distributed Ray compute from Dagster pipelines.
Rust
The Rust Pipes client allows full observability into your Rust workloads when orchestrating through Dagster.
Secoda
Community / Partner supported
Help your team understand metadata from Dagster by adding context in Secoda.
Sigma
Represent your Sigma assets in Dagster.
Slack
Up your notification game and keep stakeholders in the loop.
Sling
Extract and load data from popular data sources to destinations with Sling through Dagster.
Snowflake
3 items
Spark
Configure and run Spark jobs.
SSH/SFTP
Establish encrypted connections to networked resources.
Tableau
See and understand your data with Tableau through Dagster.
Teradata
Community / Partner supported
The community-supported `dagster-teradata` package provides an integration with Teradata.
Twilio
Integrate Twilio tasks into your data pipeline runs.
TypeScript
The TypeScript Pipes client allows integration between any TypeScript process and the Dagster orchestrator.
Weights & Biases
Community / Partner supported
Orchestrate your MLOps pipelines and maintain ML assets.
Weaviate
Using this integration, you can seamlessly integrate Weaviate into your Dagster workflows, leveraging Weaviates data warehousing capabilities for your data pipelines.