RRPproxy incident

RRPproxy unreachable due to network issues

Major Resolved View vendor source →

RRPproxy experienced a major incident on July 7, 2022 affecting XRRP API and EPP API and 1 more component, lasting 35m. The incident has been resolved; the full update timeline is below.

Started
Jul 07, 2022, 09:10 AM UTC
Resolved
Jul 07, 2022, 09:45 AM UTC
Duration
35m
Detected by Pingoru
Jul 07, 2022, 09:10 AM UTC

Affected components

XRRP APIEPP APISOAP APIXMLRPC APIHTTPS APIWeb Interface

Update timeline

  1. investigating Jul 07, 2022, 09:10 AM UTC

    Unfortunately at the moment RRPproxy is unreachable due to network issues. Our APIs and Web Interface are currently not reachable.

  2. monitoring Jul 07, 2022, 09:19 AM UTC

    Reachability is coming back to normal operations. RRPproxy APIs and Web Interface are becoming available again. We're closely monitoring the issue and will provider further updates.

  3. monitoring Jul 07, 2022, 09:38 AM UTC

    RRPproxy APIs and Web Interface reachable again. We continue to monitor the situation.

  4. resolved Jul 07, 2022, 09:45 AM UTC

    The underlying issue has been resolved. RRPproxy is back to normal operations, APIs and Web Interface fully reachable again. Please excuse any inconvenience caused.

  5. postmortem Jul 08, 2022, 11:09 AM UTC

    # Statement for short RRPproxy outage on July 7th between 08:35 and 09:10 UTC ## Issue Summary During our regular maintenance on RRPproxy's LIVE system, we noticed high database load. As a result, all queries experienced a higher response time, slowing down all commands. The following were directly affected by this; API, the Web Interface and login for issuing commands wasn't possible for a short time. All domains continued to resolve without interruption. ## Timeline and Detailed Description of Impact ### 2022-07-07 08:35 \+0000 Maintenance work started. ### 2022-07-07 08:47 \+0000 RRPproxy slowly becoming unavailable, connections were not working reliable. High database load noticed. ### 2022-07-07 09:10 \+0000 Issue resolved, load decreased and RRPproxy became fully available again. ## Remediation The cause for the high database load has been identified quickly and resolved. RRPproxy returned to normal operations, re-instating full operability. ## No Impact on Data Security The data integrity remained fully, at no point in time any data has been compromised. \_\_ As always, we remain dedicated to your success and hope this background information supports your understanding for all that transpired. If you have any questions or would like to connect with our team, please always contact us at [[email protected]](mailto:[email protected]) Your RRPproxy Team ❤️