Dagster incident

Some Dagster Cloud API Requests failing with an Internal Server Error

Major Resolved View vendor source →

Dagster experienced a major incident on April 11, 2024 affecting API, lasting 4h 23m. The incident has been resolved; the full update timeline is below.

Started
Apr 11, 2024, 05:02 PM UTC
Resolved
Apr 11, 2024, 09:25 PM UTC
Duration
4h 23m
Detected by Pingoru
Apr 11, 2024, 05:02 PM UTC

Affected components

API

Update timeline

  1. identified Apr 11, 2024, 05:02 PM UTC

    Starting earlier this week, a small number of runs in Dagster Cloud started failing with an Internal Server Error exception due to a timeout in our storage engine. We've identified the source of the problem and are in the process of rolling out a fix.

  2. identified Apr 11, 2024, 05:04 PM UTC

    We are continuing to work on a fix for this issue.

  3. monitoring Apr 11, 2024, 05:54 PM UTC

    A fix has been implemented and we are monitoring the results.

  4. resolved Apr 11, 2024, 09:25 PM UTC

    This incident has been resolved.