h8lio incident

node21 - hardware issue

Minor Resolved View vendor source →

h8lio experienced a minor incident on May 22, 2026 affecting kube.h8l.io and monitoring.h8l.io, lasting 3h 23m. The incident has been resolved; the full update timeline is below.

Started
May 22, 2026, 10:26 AM UTC
Resolved
May 22, 2026, 01:49 PM UTC
Duration
3h 23m
Detected by Pingoru
May 22, 2026, 10:26 AM UTC

Affected components

kube.h8l.iomonitoring.h8l.io

Update timeline

  1. identified May 22, 2026, 10:26 AM UTC

    The hosting provider has planed an intervention soon. In the same time, we have drained the nodes' pods and scripting the Ceph volume attachement release for pods with mounted volumes.

  2. identified May 22, 2026, 11:08 AM UTC

    Problem identified by the hosting provider : https://bare-metal-servers.status-ovhcloud.com/incidents/lncbjp1744g2 On our side, the Ceph volume attachments cleaning process is in progress. You should soon see your pods with stuck mounted volumes rescheduled.

  3. monitoring May 22, 2026, 12:22 PM UTC

    A fix has been implemented and we are monitoring the results.

  4. resolved May 22, 2026, 01:49 PM UTC

    This incident has been resolved.