Fusion incident

File Storage Connectivity Issue

Critical Resolved View vendor source →

Fusion experienced a critical incident on June 25, 2016, lasting 5h 40m. The incident has been resolved; the full update timeline is below.

Started
Jun 25, 2016, 03:34 AM UTC
Resolved
Jun 25, 2016, 09:14 AM UTC
Duration
5h 40m
Detected by Pingoru
Jun 25, 2016, 03:34 AM UTC

Update timeline

  1. identified Jun 25, 2016, 03:34 AM UTC

    We are still having issues with a vendor and our file storage. We are working to resolve this issue as fast as possible.

  2. identified Jun 25, 2016, 05:57 AM UTC

    Around 11:30pm ET, we started monitoring a network data storage issue at our main data center. In order to prevent possible issues with the Fusion application, we chose to take Fusion offline while we work to get the network issue resolved. We have no reason to believe that there is any risk of data loss, as this is purely a network connectivity issue. In preparation for the unlikely event that this outage continues, we are currently preparing for our emergency failsafe plan that would return Fusion to normal operation.

  3. identified Jun 25, 2016, 06:56 AM UTC

    It appears that the network storage is now partially operational. Due to the the fact that Fusion generally has very little use at this time of day, we are planning to leave Fusion offline while we continue to prep to mitigate any future outages that could possibly occur with this network data storage.

  4. resolved Jun 25, 2016, 09:14 AM UTC

    Fusion is now fully operational. Due to concerns with the continued reliability of the vendor that provides network storage, we have transitioned the Fusion application to a newly provisioned server that no longer relies on networked storage for certain files.