Dagster incident

Intermittent read timeouts

Minor Resolved View vendor source →

Dagster experienced a minor incident on July 7, 2023 affecting API, lasting 1h 19m. The incident has been resolved; the full update timeline is below.

Started
Jul 07, 2023, 05:43 PM UTC
Resolved
Jul 07, 2023, 07:03 PM UTC
Duration
1h 19m
Detected by Pingoru
Jul 07, 2023, 05:43 PM UTC

Affected components

API

Update timeline

  1. investigating Jul 07, 2023, 05:43 PM UTC

    We're investigating reports of intermittent read timeouts to our agent API.

  2. monitoring Jul 07, 2023, 06:02 PM UTC

    A fix has been implemented and we are monitoring the results.

  3. resolved Jul 07, 2023, 07:03 PM UTC

    A recent change to how we autoscale our webservers caused a small number of customer read timeouts (on the order of magnitude of a few dozen per hour) when connecting to our API endpoint. We've reverted these changes and the incident is now resolved.