DFDS IT incident

Problems with Service deployments on Kubernetes

Resolved after 2 hours 51 minutes, affecting Kubernetes [Hellman] - Ingress/Networking, on August 3, 2022.

postmortem Aug 25, 2022, 01:01 PM UTC

[https://github.com/dfds/postmortems/blob/master/PM2022-008 - CRUD operations on K8s Service resources unavailable.md](https://github.com/dfds/postmortems/blob/master/PM2022-008%20-%20CRUD%20operations%20on%20K8s%20Service%20resources%20unavailable.md)

Started
Aug 03, 2022, 12:45 PM UTC
Resolved
Aug 03, 2022, 03:37 PM UTC
Duration
2h 51m
Detected by Pingoru
Aug 03, 2022, 12:45 PM UTC

Affected components

Kubernetes [Hellman] - Ingress/Networking

Update timeline

  1. investigating Aug 03, 2022, 12:45 PM UTC

    We are currently experiencing problems with deploying Services (Updating/Creating) on Hellman Kubernetes cluster because of a timeout issue on the Kyverno component.

  2. identified Aug 03, 2022, 01:00 PM UTC

    The latest version of the Kyverno Helm chart is deployed to Hellman Kubernetes cluster. This should resolve the certificate issue that is currently having with Kubernetes API

  3. monitoring Aug 03, 2022, 01:29 PM UTC

    We believe that the issue has been resolved. We are currently monitoring the effect of the deployed fix

  4. resolved Aug 03, 2022, 03:37 PM UTC

    The fix is confirmed working. No more actions is needed.

  5. postmortem Aug 25, 2022, 01:01 PM UTC

    [https://github.com/dfds/postmortems/blob/master/PM2022-008 - CRUD operations on K8s Service resources unavailable.md](https://github.com/dfds/postmortems/blob/master/PM2022-008%20-%20CRUD%20operations%20on%20K8s%20Service%20resources%20unavailable.md)

Your product runs on more than DFDS IT

Add the vendors you depend on and get one message when any of them reports trouble. Free for 3 vendors, no card.

Add your stack →