DFDS IT incident

Kubernetes node failure

Notice Resolved View vendor source →

DFDS IT experienced a notice incident on May 15, 2024 affecting Kubernetes [Hellman] - Capacity/Scheduling, lasting 2h 2m. The incident has been resolved; the full update timeline is below.

Started
May 15, 2024, 10:08 AM UTC
Resolved
May 15, 2024, 12:10 PM UTC
Duration
2h 2m
Detected by Pingoru
May 15, 2024, 10:08 AM UTC

Affected components

Kubernetes [Hellman] - Capacity/Scheduling

Update timeline

  1. investigating May 15, 2024, 10:08 AM UTC

    We currently have an issue with a Kubernetes node crashing which has resulted in some terminated pods. These should be recreated on a different node automatically. We are currently investigating the issue

  2. monitoring May 15, 2024, 10:17 AM UTC

    The faulty node is now removed from the cluster. We will monitor for signs of reoccurence

  3. resolved May 15, 2024, 12:10 PM UTC

    This incident has been resolved.