Patchman incident
Reduced performance on Portal and Customer API
Patchman experienced a major incident on August 11, 2021 affecting Portal and Customer API and 1 more component, lasting 20h 48m. The incident has been resolved; the full update timeline is below.
Affected components
Update timeline
- investigating Aug 11, 2021, 09:43 AM UTC
We are currently seeing a reduction in performance on the Portal and Customer API. At this stage we are unsure whether this is related to the maintenance performed earlier today. We are investigating the issues. You may experience slow loading of pages, intermittent connection timeouts, and slow API responses.
- investigating Aug 11, 2021, 11:01 AM UTC
We are still investigating this issue.
- identified Aug 11, 2021, 01:10 PM UTC
We have identified a potential problem and are working on implementing a solution. We expect this will come with minor downtime. This post will be updated as we progress.
- identified Aug 11, 2021, 01:16 PM UTC
We are starting emergency maintenance to resolve the performance problems. You may see increased latency on requests to Portal and the Customer API. You will also see a delay in information in the Portal related to scan and detection data. This will be resynchronized automatically after the issues are resolved.
- identified Aug 11, 2021, 01:43 PM UTC
The Portal and Customer API are currently down for a maximum of 5 minutes.
- identified Aug 11, 2021, 01:47 PM UTC
The systems are all online again. Our emergency maintenance is ongoing.
- identified Aug 11, 2021, 02:40 PM UTC
We are unfortunately not seeing enough improvement. We are investigating other options.
- identified Aug 11, 2021, 04:43 PM UTC
The situation is currently improving. We continue to monitor the situation and are ready to act where appropriate.
- monitoring Aug 11, 2021, 07:51 PM UTC
A fix has been implemented and we are monitoring the results.
- resolved Aug 12, 2021, 06:32 AM UTC
This incident has been resolved.