RRPproxy incident
ns1.rrpproxy.net/ns1.dnsres.net unreachable via IPv4
RRPproxy experienced a major incident on July 29, 2021 affecting DNS resolution, lasting 4h 10m. The incident has been resolved; the full update timeline is below.
Affected components
Update timeline
- investigating Jul 29, 2021, 10:04 PM UTC
We are currently investigating this issue.
- investigating Jul 29, 2021, 10:49 PM UTC
It seems there is currently a routing issue within the network of our datacenter provider OVH in France. We have escalated the issue to them accordingly, investigation is still ongoing.
- investigating Jul 30, 2021, 12:42 AM UTC
The data center provider has confirmed this to be regional routing issue. Investigation is still in progress.
- identified Jul 30, 2021, 01:46 AM UTC
The issue has been identified and a fix is being implemented.
- resolved Jul 30, 2021, 01:56 AM UTC
The issues have been resolved. We will provide a statement as soon as we have received the statement and root-cause analysis from our data center provider. We sincerely apologize for the inconvenience caused.
- postmortem Jul 30, 2021, 01:16 PM UTC
We have received a final statement and confirmation from our datacenter provider that the issue is indeed resolved. The issue was due to a problem with devices replaced in a network switch. Following the replacement, the traffic going through this switch was routed to the wrong router. The administrators of our datacenter provider fixed that configuration which resolved the issue. We kindly ask to excuse any inconvenience caused.