Dagster incident

Cannot launch runs in Serverless

Major Resolved View vendor source →

Dagster experienced a major incident on August 3, 2023 affecting API, lasting 53m. The incident has been resolved; the full update timeline is below.

Started
Aug 03, 2023, 08:29 PM UTC
Resolved
Aug 03, 2023, 09:23 PM UTC
Duration
53m
Detected by Pingoru
Aug 03, 2023, 08:29 PM UTC

Affected components

API

Update timeline

  1. investigating Aug 03, 2023, 08:29 PM UTC

    We are currently investigating this issue.

  2. monitoring Aug 03, 2023, 09:09 PM UTC

    We are seeing runs successfully launch as of 20:50 UTC. We are continuing to monitor the situation.

  3. resolved Aug 03, 2023, 09:23 PM UTC

    AWS was experiencing increased API error rates and latencies for their EC2 APIs, which impacted AWS services making use of these APIs. This included AWS Fargate, which is used in Dagster Cloud Serverless. Their incident was resolved as of 21:18 UTC.