Qwilr experienced a major incident on January 26, 2021 affecting Published Qwilr Pages and Qwilr App, lasting 4h 33m. The incident has been resolved; the full update timeline is below.
Affected components
Update timeline
- investigating Jan 26, 2021, 03:54 AM UTC
Monitoring indicates inaccessibility to the app and public pages. Currently investigating the cause of the issue.
- monitoring Jan 26, 2021, 04:15 AM UTC
It appears that a recent deployment caused some outage of the app where the servers became unresponsive. We are currently doing a deeper investigation but rolling back to an earlier version appears to have brought the server connectivity back online.
- investigating Jan 26, 2021, 05:15 AM UTC
Some additional issues have been identified causing much slower requests than usual. Proceeding with further investigations.
- investigating Jan 26, 2021, 05:27 AM UTC
Continuing investigation. It appears that Qwilr is accessible although we are still experiencing some degraded performance in the app.
- monitoring Jan 26, 2021, 05:42 AM UTC
Some long running db queries were preventing normal performance within the app, resulting in the degraded performance. We have terminated the queries and are continuing investigation into root cause, which appears to be some code changes added in the rolled back changes. Not expecting any further degradation.
- resolved Jan 26, 2021, 08:28 AM UTC
App appears to be functioning as normal again.