Dagster incident

dagster.plus redirect breaks login for some organizations

Major Resolved View vendor source →

Dagster experienced a major incident on April 17, 2024 affecting API and Dagster Cloud UI, lasting 33m. The incident has been resolved; the full update timeline is below.

Started
Apr 17, 2024, 01:20 PM UTC
Resolved
Apr 17, 2024, 01:53 PM UTC
Duration
33m
Detected by Pingoru
Apr 17, 2024, 01:20 PM UTC

Affected components

APIDagster Cloud UI

Update timeline

  1. identified Apr 17, 2024, 01:20 PM UTC

    In preparation for our Dagster+ launch, we erroneously began redirecting dagster.cloud to dagster.plus. We are rolling back this change now. If you continue to have trouble logging in, you may need to clear your browser's cache.

  2. monitoring Apr 17, 2024, 02:19 PM UTC

    A fix has been implemented and we are monitoring the results.

  3. resolved Apr 17, 2024, 03:41 PM UTC

    In anticipation of today's Dagster+ launch event, we added a second domain to our app: dagster.plus. Last night, we erroneously started redirecting certain requests from dagster.cloud to dagster.plus. As a result, organizations who explicitly allow-list dagster.cloud in their corporate firewalls saw redirected requests to dagster.plus fail. Affected requests included: - Interactive use of the Dagster web interface - GraphQL queries authenticated with a user token (for example, many CI/CD jobs) Agent interactions (including launching runs and storing events) were not redirected and continued to operate as expected. Organizations without these firewall settings were not affected. Once detected, we began working on a way to selectively disable redirects for affected organizations. Shortly after, we removed redirects entirely for all organizations. However, many browsers permanently cache redirects. If you continue to have trouble accessing dagster.cloud please clear your browser cache and try again. Internally, we're conducting a full postmortem and deciding how to more safely introduce our new domain name in the future.