Proxyclick incident

Users may be unable to access the Dashboard

Major Resolved View vendor source →

Proxyclick experienced a major incident on February 21, 2024 affecting Dashboard, lasting 7h 5m. The incident has been resolved; the full update timeline is below.

Started
Feb 21, 2024, 11:25 AM UTC
Resolved
Feb 21, 2024, 06:31 PM UTC
Duration
7h 5m
Detected by Pingoru
Feb 21, 2024, 11:25 AM UTC

Affected components

Dashboard

Update timeline

  1. investigating Feb 21, 2024, 11:25 AM UTC

    We are currently investigating reports of login authentication failures for the Proxyclick Dashboard

  2. identified Feb 21, 2024, 12:06 PM UTC

    A root cause has been identified and a fix is currently being deployed to our production environment. We expect performance to stabilize within the next 30 minutes.

  3. monitoring Feb 21, 2024, 12:20 PM UTC

    Issues related to this incident should now be resolved, we will continue to monitor all authentication endpoints for any unexpected behavior

  4. monitoring Feb 21, 2024, 12:20 PM UTC

    We are continuing to monitor for any further issues.

  5. resolved Feb 21, 2024, 06:31 PM UTC

    Incident resolved, no further errors recorded from 13:12 CET onwards.

  6. postmortem Feb 27, 2024, 02:00 PM UTC

    A security update was deployed to our production environment, this unexpectedly resulted in multiple authentication methods for the platform being restricted. The update rollback was initiated around 12:48 CET with a full recovery at 13:12 CET.