External metrics, such as Snowflake credits, can be integrated into the Dagster Insights UI. The dagster-cloud package contains utilities for capturing and submitting external metrics about data operations to Dagster+ via an API.
Before you start, note that:
- This is a Dagster+ Pro feature
- Up to two million individual data points may be added to Insights, per month
- External metrics data will only be retained for 120 days
Currently, Insights supports integrating metrics for:
Usage generated by queries made to Google BigQuery and Snowflake resources. Refer to the BigQuery and Snowflake integration guides for more information.
Google BigQuery and Snowflake usage generated by dbt. Refer to the BigQuery and Snowflake dbt integration guides for more information.