Flying Sphinx incident

API requests are failing due to a third-party issue.

Critical Resolved View vendor source →

Flying Sphinx experienced a critical incident on November 7, 2022 affecting API, lasting 1h 56m. The incident has been resolved; the full update timeline is below.

Started
Nov 07, 2022, 12:33 AM UTC
Resolved
Nov 07, 2022, 02:30 AM UTC
Duration
1h 56m
Detected by Pingoru
Nov 07, 2022, 12:33 AM UTC

Affected components

API

Update timeline

  1. identified Nov 07, 2022, 12:33 AM UTC

    We're seeing a failure from an essential third-party API which is stopping our own requests from working - actions that involve reindexing or restarting Sphinx daemons aren't being completed. Search requests are not impacted by this change, though. The issue has been raised with the third-party vendor, and we're hoping for a swift resolution.

  2. monitoring Nov 07, 2022, 02:02 AM UTC

    The third-party has implemented a fix, errors on our side have stopped but will continue to monitor the situation.

  3. resolved Nov 07, 2022, 02:30 AM UTC

    All functionality has returned to normal. Thanks for your patience, and if you're finding any problems are persisting, please do get in touch.