Skip to main content

Dagster & ADBC

Community integration

This is a community-maintained integration. To report bugs or leave feedback, open an issue in the Dagster community integrations repo.

The community-supported dagster-adbc package provides an ADBCResource for connecting to ADBC-compatible databases in Dagster.

Installation​

uv add dagster-adbc

Install the ADBC driver for your database. For example, using dbc:

uv pip install dbc
dbc install flightsql

Example​

from dagster import Definitions, EnvVar, asset
from dagster_adbc import ADBCResource


@asset
def my_table(dremio: ADBCResource) -> None:
    with dremio.get_connection() as connection, connection.cursor() as cursor:
        cursor.execute("SELECT * FROM my_table")
        table = cursor.fetch_arrow_table()


defs = Definitions(
    assets=[my_table],
    resources={
        "dremio": ADBCResource(
            driver="flightsql",
            uri="grpc+tcp://localhost:32010",
            db_kwargs={"username": "admin", "password": EnvVar("DREMIO_PASSWORD")},
        )
    },
)

About ADBC​

Apache Arrow ADBC is a standard API for database access built on Apache Arrow.