PriceHubble experienced a notice incident on July 27, 2022 affecting API, lasting 7d 22h. The incident has been resolved; the full update timeline is below.
Affected components
Update timeline
- monitoring Jul 27, 2022, 02:16 PM UTC
Dear Customers, We have rolled out a hotfix which should improve the stability of our API endpoints. We also extended our observability capabilities to better isolate the issue. Currently, we are in the phase of monitoring and collecting further metrics to verify if all affected services have been stabilised by the hotfix. Thank you for your understanding!
- monitoring Jul 28, 2022, 08:27 AM UTC
Dear Customers, Thanks to the extended metric collection we could further isolate the problem we are facing. This triggered further mitigation steps from our side which we are implementing and rolling out. Next update can be expected at 12.00 CEST
- monitoring Jul 28, 2022, 10:12 AM UTC
Dear Customers, We have prepared the required patches and we are in the process of releasing them. Following the releases, we will closely monitor the situation and release subsequent updates if needed. Next update can be expected at 14:00 CEST
- monitoring Jul 28, 2022, 12:46 PM UTC
Dear Customers, We have finished with the roll-out phase of the prepared patches and we are currently monitoring the situation. Next update can be expected at 16:00 CEST
- monitoring Jul 28, 2022, 02:55 PM UTC
Dear Customers, We haven't detected any API endpoint instability since the release of the patches. We will keep monitoring the situation. Next update can be expected at 2022.07.29 10:00 CEST
- monitoring Jul 29, 2022, 08:04 AM UTC
Dear Customers, We haven't detected any API endpoint instability since the release of the patches. We will keep monitoring the situation. Next update can be expected at 2022.07.29 12:00 CEST
- monitoring Jul 29, 2022, 03:16 PM UTC
Dear Customers, in the last hours we have released two more fixes for our services, which we are actively monitoring. The series of fixes deployed over the last days allow us to say that services are stable at the present time, but we will keep the incident open until we are thoroughly convinced it is over. Over the weekend our team will remain on duty monitoring the situation and the updates will be sparse. In this case, no update will be good news.
- monitoring Aug 03, 2022, 01:23 PM UTC
Dear customers, We could successfully rollout all fixes and our systems are now stable. We will continue to closely monitor the situation until tomorrow. This incident will be closed tomorrow if no more problems are observed. Thank you very much
- resolved Aug 04, 2022, 12:55 PM UTC
Dear customers, The technical incident that started on Thursday 21 of July is considered resolved. Corporate communication is being prepared and will follow up shortly. Thank you