Ask AI

Dagster+ Insights#

Using Dagster+ Insights, you can gain visibility into historical usage and cost metrics such as Dagster+ run duration, credit usage, and failures. You can also:


How it works#

Insights makes it easier to capture operational data not only from Dagster pipelines, but also downstream systems. Visualizations are built right into the Dagster UI, allowing you to explore Dagster usage alongside metrics from other platforms, like Google BigQuery.

To access Insights, click Insights in the top navigation bar in the UI:

Viewing the Insights tab in the Dagster UI

The left navigation panel on this page contains a list of available metrics. For each metric, the daily, weekly, or monthly aggregated values are displayed in the graph.

Use the tabs above the charts to view metrics for Assets, Asset groups, Jobs, and Deployments.

These metrics are updated on a daily basis. Refer to the Available metrics section for more information about these metrics.

Data retention#

How long historical Insights data is retained depends on your Dagster+ plan:

  • Dagster+ Pro - 120 days
  • All other plans - 30 days

Available metrics#

MetricDescription
Dagster creditsThe Dagster credit cost associated with computing this object. Dagster credits are charged for every step that is run, and for every asset that is materialized. For more information, refer to the pricing FAQ.
Compute durationThe time spent computing steps. For jobs that run steps in parallel, the compute duration may be longer than the wall clock time it takes for the run to complete.
MaterializationsThe number of asset materializations associated with computing this object.
ObservationsThe number of asset observations associated with computing this object.
Step failuresThe number of times steps failed when computing this object. Note: Steps that retry and succeed are not included in this metric.
Step retriesThe number of times steps were retried when computing this object.
Asset check warningsThe number of asset checks that produced warnings.
Asset check errorsThe number of asset checks that produced errors.
Retry computeThe time spent computing steps, including time spent retrying failed steps. For jobs that run steps in parallel, the compute duration may be longer than the wall clock time it takes for the run to complete.

Working with metrics#

Integrating other metrics#

Other metrics, such as asset materialization metadata or Snowflake credits, can be integrated into Dagster Insights. Insights currently supports the following external metrics:

Exporting metrics#

Metrics in Dagster+ Insights can be exported using a GraphQL API endpoint. Refer to the Exporting Insights metrics from Dagster+ guide for details.