Zipline incident

Outage due to broken deployment.

Critical Resolved View vendor source →

Zipline experienced a critical incident on September 28, 2023 affecting Core Platform and Search and 1 more component, lasting 9h 26m. The incident has been resolved; the full update timeline is below.

Started
Sep 28, 2023, 09:40 PM UTC
Resolved
Sep 29, 2023, 07:07 AM UTC
Duration
9h 26m
Detected by Pingoru
Sep 28, 2023, 09:40 PM UTC

Affected components

Core PlatformSearchPublishingNotificationsFilesInsightsResource Library

Update timeline

  1. identified Sep 28, 2023, 09:40 PM UTC

    Our previous deployment has run into a snag in production. We're rolling back the deployment and service should be resumed within the next 5 minutes. We apologise for the impact to your day

  2. identified Sep 28, 2023, 09:44 PM UTC

    The application is back up, and we are rebooting satellite services

  3. monitoring Sep 28, 2023, 09:44 PM UTC

    We have rolled back and are monitoring all systems to ensure stability.

  4. monitoring Sep 28, 2023, 09:48 PM UTC

    Services are back up and running we will continue to monitor the application to ensure there are no further hiccups

  5. resolved Sep 29, 2023, 07:07 AM UTC

    This incident has been resolved.