Inpart experienced a critical incident on December 10, 2019 affecting Production, lasting 1d 4h. The incident has been resolved; the full update timeline is below.
Affected components
Update timeline
- investigating Dec 10, 2019, 10:12 AM UTC
Dear users, We are currently experiencing a major authentication system outage. This is causing login issues for all Inova applications. We are actively working to resolve this incident as soon as possible. Kind regards, The Inova Software team
- monitoring Dec 10, 2019, 12:06 PM UTC
Dear users, This incident is now resolved. We are now working to figure out exactly what happened and we continue to monitor the situation closely. Thank you for bearing with us, and apologies again for the disruption. Kind regards, The Inova Software team
- resolved Dec 11, 2019, 02:47 PM UTC
Dear users, Yesterday, around 10:30 am CET, we encountered a failure of the authentication system that caused intermittent connection issues for many of you. Our Operations Team worked hard to get everything back up and running within the shortest time possible : - As a quick fix, they first tried to reboot our authentication system. But, unfortunately, the issue was quickly reappearing after each restart. - Therefore, they continued their investigations and analyzed the log files. - Around 11:45 am CET, the root cause of the incident was identified: our authentication system was no longer running efficiently due to degraded indexes. - So, to fix this issue, they had to completely rebuild those indexes. Since yesterday noon, our Operations Team has not detected any new incident. The authentication system is running normally and is stable. We are continuing to closely monitor the situation and will implement preventive measures to reduce the risk of recurrence of this issue. We thank you for your understanding and your support while we worked on recovering services and hope this inconvenience was manageable for you. Kind regards, The Inova Software team