Zipline incident

Partial downtime caused by upstream provider

Critical Resolved View vendor source →

Zipline experienced a critical incident on February 24, 2022 affecting Core Platform and Search and 1 more component, lasting 3h 3m. The incident has been resolved; the full update timeline is below.

Started
Feb 24, 2022, 04:42 PM UTC
Resolved
Feb 24, 2022, 07:45 PM UTC
Duration
3h 3m
Detected by Pingoru
Feb 24, 2022, 04:42 PM UTC

Affected components

Core PlatformSearchEmail HandlingPublishingNotificationsFiles

Update timeline

  1. investigating Feb 24, 2022, 04:42 PM UTC

    Our monitoring system has alerted us to the application being inaccessible for some users. It appears our upstream provider, Heroku, is having issues. We are investigating and preparing for any changes necessary if it is not resolved quickly.

  2. investigating Feb 24, 2022, 05:13 PM UTC

    We have heard from Heroku and they are working on fixing the issue. At the same time, we're working on two different backup plans in case it takes them much longer to resolve.

  3. monitoring Feb 24, 2022, 05:18 PM UTC

    We're seeing the site come back for most users. It seems that the issue has mostly been resolved but we are checking everything and monitoring the fix.

  4. monitoring Feb 24, 2022, 05:21 PM UTC

    Our monitoring is indicating that everything is back up and running smoothly. We're continuing to monitor the situation.

  5. resolved Feb 24, 2022, 07:45 PM UTC

    This incident has been resolved.