Proxyclick incident

Users may be unable to sync kiosks or launch the Proxyclick app

Major Resolved View vendor source →

Proxyclick experienced a major incident on April 26, 2022 affecting iPad app, lasting 42m. The incident has been resolved; the full update timeline is below.

Started
Apr 26, 2022, 02:12 PM UTC
Resolved
Apr 26, 2022, 02:55 PM UTC
Duration
42m
Detected by Pingoru
Apr 26, 2022, 02:12 PM UTC

Affected components

iPad app

Update timeline

  1. investigating Apr 26, 2022, 02:12 PM UTC

    We are currently investigating an issue where kiosks are unable to connect to an account.

  2. identified Apr 26, 2022, 02:49 PM UTC

    The issue has been identified.

  3. monitoring Apr 26, 2022, 02:51 PM UTC

    An issue with API endpoints has been identified and a fix has been implemented, we are monitoring performance.

  4. resolved Apr 26, 2022, 02:55 PM UTC

    This incident has been resolved, all components are back to working properly. A post mortem analysis will be provided.

  5. postmortem Apr 26, 2022, 02:55 PM UTC

    One API node failed to correctly initialize after deployment of our latest product update. This caused intermittent failures for the Kiosk application during loading. Restarting all API nodes resolved this issue. We are monitoring the API nodes to ensure all nodes are responding correctly, and will implement improved post-deployment health checks to prevent this issue in the future.