Pinpoint incident

Minor System Outage

Critical Resolved View vendor source →

Pinpoint experienced a critical incident on November 6, 2022, lasting —. The incident has been resolved; the full update timeline is below.

Started
Nov 06, 2022, 10:16 PM UTC
Resolved
Nov 06, 2022, 09:30 PM UTC
Duration
Detected by Pingoru
Nov 06, 2022, 10:16 PM UTC

Update timeline

  1. resolved Nov 06, 2022, 10:16 PM UTC

    Web servers are currently not configured to serve requests.

  2. postmortem Nov 06, 2022, 10:17 PM UTC

    As part of routine maintenance we were installing security updates on our web servers. The process for this involved systematically removing them from serving requests, installing the updates and then adding them back into the load balancer so that they could continue to process requests. A configuration issue lead to updated servers not being added back into the load balancer. Our development team were quick to recognise and rectify the issue. Our internal processes have changed in order to prevent this happening again in the future.