ETHERFAX experienced a major incident on March 16, 2020 affecting U.S. REST Services and Canada REST Services, lasting 2h 11m. The incident has been resolved; the full update timeline is below.
Affected components
Update timeline
- investigating Mar 16, 2020, 07:38 PM UTC
Engineers are currently investigating issues.
- monitoring Mar 16, 2020, 07:43 PM UTC
Engineers have identified an issue with a load balancer. The system failed over to the redundant load balancer and we are seeing successful connections. We are continuing to monitor.
- monitoring Mar 16, 2020, 07:44 PM UTC
All services are showing up at this time.
- monitoring Mar 16, 2020, 07:54 PM UTC
Engineers have submitted logs from the event to the load balancer vendor for review.
- resolved Mar 16, 2020, 09:49 PM UTC
The system has remained stable. Engineers are continuing to work with the vendor technical support determine the root cause of the failure on the primary load balancer node. Further details related to that investigation will be provided in the post-mortem.