Proxyclick incident

Users are unable to log into the web application

Notice Resolved View vendor source →

Proxyclick experienced a notice incident on June 1, 2023, lasting —. The incident has been resolved; the full update timeline is below.

Started
Jun 01, 2023, 08:18 AM UTC
Resolved
Jun 01, 2023, 04:00 AM UTC
Duration
—
Detected by Pingoru
Jun 01, 2023, 08:18 AM UTC

Update timeline

  1. resolved Jun 01, 2023, 08:18 AM UTC

    This incident is now resolved. Post-mortem to come.

  2. postmortem Jun 02, 2023, 06:34 AM UTC

    **Root Cause Analysis:** Between 05:35 and 06:52 CET some API nodes could not respond to incoming requests. The API nodes which failed were not removed from our cluster correctly, which led to intermittent authentication issues for some users. **Preventative Action:** Our engineering and infrastructure teams are working on a solution to isolate our API nodes, improving error detection and remedial action in the event of performance issues.