RRPproxy incident

Reachability issues for api.rrproxy.net and www.rrpproxy.net due to DNS problems

Minor Resolved View vendor source →

RRPproxy experienced a minor incident on December 15, 2022 affecting DNS resolution, lasting 2h 31m. The incident has been resolved; the full update timeline is below.

Started
Dec 15, 2022, 12:55 PM UTC
Resolved
Dec 15, 2022, 03:26 PM UTC
Duration
2h 31m
Detected by Pingoru
Dec 15, 2022, 12:55 PM UTC

Affected components

DNS resolution

Update timeline

  1. investigating Dec 15, 2022, 12:55 PM UTC

    We are currently investigating this issue.

  2. identified Dec 15, 2022, 01:02 PM UTC

    The issue has been identified and a fix is being implemented.

  3. monitoring Dec 15, 2022, 01:23 PM UTC

    A fix has been implemented and we are monitoring the results.

  4. resolved Dec 15, 2022, 03:26 PM UTC

    This incident has been resolved.

  5. postmortem Dec 15, 2022, 03:43 PM UTC

    On Thursday December 15th, 2023 between 12:40 and 13:10 UTC after performing DNS adjustments [rrpproxy.net](http://rrpproxy.net) and [api.rrpproxy.net](http://api.rrpproxy.net) showed in our monitoring as only partially available from some locations. Our services were running without interruption, however connection attempts may have failed in some occasions. We kindly ask to pardon for all inconveniences caused. ## Timeline ### 12:40 UTC * Applying changes for [rrproxy.net](http://rrproxy.net) zone. * Changes deployed and shortly after DNS resolution stopped from some locations, caused by DNSSEC issues. ### 13:04 UTC * Issues still ongoing. * Zones slowly recovering but still seeing issues from some locations and partial availability. ### 13:10 UTC * All zones fully available again.