ETHERFAX incident

DNS Resolution Failures

Major Resolved View vendor source →

ETHERFAX experienced a major incident on March 10, 2021 affecting U.S. REST Services and Canada REST Services and 1 more component, lasting 1h 47m. The incident has been resolved; the full update timeline is below.

Started
Mar 10, 2021, 11:51 PM UTC
Resolved
Mar 11, 2021, 01:39 AM UTC
Duration
1h 47m
Detected by Pingoru
Mar 10, 2021, 11:51 PM UTC

Affected components

U.S. REST ServicesCanada REST ServicesU.S. SMS ServicesCustomer PortalReseller Portal

Update timeline

  1. investigating Mar 10, 2021, 11:51 PM UTC

    Engineers are currently monitoring reports of DNS resolution failures with our DNS provider. More updates to follow.

  2. investigating Mar 11, 2021, 12:12 AM UTC

    We are currently engaged with our DNS provider to determine extent of outage and an ETR. A host file can be temporarily added for the following based on your connection point: US: na.connect.etherfax.net 4.71.144.154 connect.etherfax.net 4.71.144.154 CA: ca.connect.etherfax.net 4.28.142.21

  3. monitoring Mar 11, 2021, 12:40 AM UTC

    We're seeing resolution and it appears the DNS provider is back up. We're continuing to monitor.

  4. monitoring Mar 11, 2021, 12:43 AM UTC

    We are continuing to monitor for any further issues.

  5. monitoring Mar 11, 2021, 01:07 AM UTC

    Engineers did add additional nameservers for an alternate provider as well. DNS logging may reflect alternate name servers. Resolution has continued to remain stable.

  6. resolved Mar 11, 2021, 01:39 AM UTC

    DNS provider advises that mitigating actions have been taken and services are recovered and stable. Further information to follow as well as a post-mortem for etherFAX will be provided.

  7. postmortem Mar 17, 2021, 02:03 PM UTC

    etherFAX has published an RFO available here: [Post-Mortem Assessment | DNS Provider Outage | March 10th, 2021 ](https://www.etherfax.net/wp-content/uploads/2021/03/EF_20210310_Incident_PostMortem.pdf)