RIPE Network Coordination Centre incident

Issues with longitudinal RIS data APIS (e.g. routing history)

Minor Resolved View vendor source →

RIPE Network Coordination Centre experienced a minor incident on May 7, 2026, lasting —. The incident has been resolved; the full update timeline is below.

Started
May 07, 2026, 03:48 PM UTC
Resolved
May 07, 2026, 03:48 PM UTC
Duration
Detected by Pingoru
May 07, 2026, 03:48 PM UTC

Update timeline

  1. resolved May 07, 2026, 03:48 PM UTC

    May 7 , 17:48 CEST Resolved - This incident has been resolved. May 7 , 14:16 CEST Monitoring - The root cause was a dataset desynchronising between the two backend environments after the hadoop master failed. The hadoop master contains a single point of failure (the job scheduler). The on-premise environment was still processing data, while the other is 24h-36h behind. We have rolled back to only using the on-premise environment and cleared the cached data. This should have mitigated the issue. We are monitoring the results. May 7 , 13:31 CEST Identified - This quarter, we are migrating the RIS/RIPEstat data to rented bare metal. Because we are in the final steps of this migration, part of the requests are routed to the new backend environment to evaluate the performance impact. A key component in the hadoop environment of the new environment failed today (the active hadoop master node). This caused part of our backend cluster to become unresponsive and return empty data when returning responses from the new cluster. Unfortunately these results poisoned a cache that is shared by the whole application, causing the system to be fully unavailable for these datasets. We are working on a mitigation. May 7 , 13:12 CEST Investigating - We are investigating an issue with some RIPEstat datasets. As a user you may see "There was a problem handling this request. [...]" error messages.