DFDS IT incident

ADFS intermittent login issues

Critical Resolved View vendor source →

DFDS IT experienced a critical incident on September 7, 2022, lasting 9d 1h. The incident has been resolved; the full update timeline is below.

Started
Sep 07, 2022, 08:09 AM UTC
Resolved
Sep 16, 2022, 09:20 AM UTC
Duration
9d 1h
Detected by Pingoru
Sep 07, 2022, 08:09 AM UTC

Update timeline

  1. investigating Sep 07, 2022, 08:09 AM UTC

    We are currently investigating this issue.

  2. investigating Sep 08, 2022, 12:11 PM UTC

    Seems to be almost entirely down now. Still having someone looking into the issue, but unfortunately ADFS is not a service we manage ourselves.

  3. investigating Sep 08, 2022, 01:44 PM UTC

    Should be accessible remotely again. Still investigating the intermittent request timeouts.

  4. investigating Sep 09, 2022, 06:57 AM UTC

    There is a major outage on ADFS, blocking logins to Kubernetes and AWS. ADFS is not a service managed by Cloud Engineering, so we have reached out to IT and will update when we hear more.

  5. investigating Sep 09, 2022, 07:37 AM UTC

    We have raised a SEV1 ticket with Network, and expect an update within 30 minutes.

  6. monitoring Sep 09, 2022, 08:04 AM UTC

    ADFS seems available again. We will continue to monitor the situation.

  7. resolved Sep 16, 2022, 09:20 AM UTC

    Firewall changes were applied at 16:00 CET 14-Sep-2022 (internal firewall) and 10:00 CET 15-Sep-2022 (external firewall), changing the packet inspection rules. ADFS functionality and performance have been stable since then.