Proxyclick incident

Users may be unable to access the Dashboard and other components

Critical Resolved View vendor source →

Proxyclick experienced a critical incident on December 20, 2021 affecting Dashboard and iPad app and 1 more component, lasting 1h 6m. The incident has been resolved; the full update timeline is below.

Started
Dec 20, 2021, 09:39 AM UTC
Resolved
Dec 20, 2021, 10:46 AM UTC
Duration
1h 6m
Detected by Pingoru
Dec 20, 2021, 09:39 AM UTC

Affected components

DashboardiPad appBrowser-based KioskSMSMailSlackSkype for BusinessAPIWebhooksBox integration

Update timeline

  1. investigating Dec 20, 2021, 09:39 AM UTC

    We are currently investigating the issue

  2. monitoring Dec 20, 2021, 10:10 AM UTC

    A fix has been implemented, we are currently monitoring the situation.

  3. resolved Dec 20, 2021, 10:46 AM UTC

    This incident has been resolved. Additional information will be included in post-mortem.

  4. postmortem Dec 20, 2021, 03:23 PM UTC

    At approximately 09:15 AM CET, we experienced an outage which impacted the ability for some users to log in to the Dashboard. Our team discovered a failure in the database migration process which triggered a downstream issue with our DNS. We identified the issue immediately via our automated notification system and started to work on a fix, subsequently releasing a patch at 10:08 AM CET. The Dashboard was therefore unavailable for about 60 minutes. The team is resolving the underlying issues that caused this, to prevent any outage impacting the accessibility of our web application.