dataforest incident

epyc9754-2 outage

Minor Resolved View vendor source →

dataforest experienced a minor incident on April 22, 2025 affecting Virtual Servers, lasting 2h 22m. The incident has been resolved; the full update timeline is below.

Started
Apr 22, 2025, 12:57 AM UTC
Resolved
Apr 22, 2025, 03:19 AM UTC
Duration
2h 22m
Detected by Pingoru
Apr 22, 2025, 12:57 AM UTC

Affected components

Virtual Servers

Update timeline

  1. investigating Apr 22, 2025, 01:05 AM UTC

    We are currently experiencing an outage of the EPYC Rootserver node epyc9754-2. Our team is actively working to resolve this issue. You can check in the control panel if you have VMs on the affected host.

  2. monitoring Apr 22, 2025, 02:58 AM UTC

    Unfortunately, all recovery attempts for the affected node were unsuccessful – the hardware is faulty and will be repaired later. Thanks to our redundant Ceph storage, affected VMs can be started on other nodes. We’ve already begun the migration and the first VMs are back online.

  3. resolved Apr 22, 2025, 03:19 AM UTC

    All VMs were started on replacement hardware.