BlueFox Host experienced a critical incident on May 1, 2021 affecting New York, US/1 (BHNY1) and Dallas, US/1 (BHDA1), lasting 4h 58m. The incident has been resolved; the full update timeline is below.
Affected components
Update timeline
- investigating May 01, 2021, 10:36 AM UTC
We are currently investigating this issue.
- investigating May 01, 2021, 10:36 AM UTC
We are continuing to investigate this issue.
- identified May 01, 2021, 10:42 AM UTC
We are communicating with our suppliers to restore availability to BHDA1
- identified May 01, 2021, 10:44 AM UTC
We have fixed the redundancy in the billing system
- identified May 01, 2021, 10:52 AM UTC
Corespace are not experiencing issues, we are trying to communicate with NextArray LLC on the outage.
- identified May 01, 2021, 01:55 PM UTC
NextArray LLC are not communicating with us on the issue, there is no ETA on when services will be restored.
- identified May 01, 2021, 02:23 PM UTC
bh007 has been restored.
- identified May 01, 2021, 02:25 PM UTC
bh006 has been restored.
- monitoring May 01, 2021, 02:27 PM UTC
Services have been restored, we are monitoring the situation.
- monitoring May 01, 2021, 02:39 PM UTC
We are still monitoring performance and uptime
- monitoring May 01, 2021, 02:43 PM UTC
Most services appear to be functioning as expected, we are continuing to monitor.
- resolved May 01, 2021, 02:56 PM UTC
This incident has been resolved. An edge device in Dallas-Cor (NexusArray LLC) failed in their datacenter, the site does not have any redundancy. This caused the sites network connection to be completely isolated. It took approx ~11 hours for the site to restore network connectivity.