Flying Sphinx incident

Carmenta is down

Critical Resolved View vendor source →

Flying Sphinx experienced a critical incident on September 21, 2018 affecting Carmenta, lasting 52m. The incident has been resolved; the full update timeline is below.

Started
Sep 21, 2018, 07:52 AM UTC
Resolved
Sep 21, 2018, 08:45 AM UTC
Duration
52m
Detected by Pingoru
Sep 21, 2018, 07:52 AM UTC

Affected components

Carmenta

Update timeline

  1. identified Sep 21, 2018, 07:52 AM UTC

    Greatly delayed alert, but Carmenta has unexpectedly restarted itself and crashed halfway through the process. Working on getting a replacement sorted now, expected resolution in 40 minutes.

  2. monitoring Sep 21, 2018, 08:24 AM UTC

    A new server for Carmenta is running, affected customers should find things are working now. Continuing to monitor to confirm that the issue is resolved.

  3. resolved Sep 21, 2018, 08:45 AM UTC

    Everything's now back to normal. Will make sure such fixes don't get delayed so badly again! If anyone's still seeing problems persist, please get in touch.