DocNetwork experienced a major incident on December 7, 2021 affecting Application, lasting 1d 1h. The incident has been resolved; the full update timeline is below.
Affected components
Update timeline
- investigating Dec 07, 2021, 02:53 PM UTC
Our notifications system is currently down. We're investigating.
- identified Dec 07, 2021, 02:56 PM UTC
We've identified the cause of the issue and are working to resolve the issue.
- identified Dec 07, 2021, 03:46 PM UTC
We're continuing to investigate possible fixes
- identified Dec 07, 2021, 04:18 PM UTC
We're continuing to investigate solutions, but our capabilities are hampered by the current AWS console outage.
- identified Dec 07, 2021, 05:30 PM UTC
We are continuing to work on a fix for this issue.
- identified Dec 07, 2021, 06:00 PM UTC
We are continuing to work on a fix for this issue.
- identified Dec 07, 2021, 06:48 PM UTC
The current AWS outage continues to prevent thorough testing and implementation of the possible solutions we've identified. We're also investigating possible temporary workarounds to restore the notifications service.
- identified Dec 07, 2021, 10:28 PM UTC
We're continuing to investigate workaround and monitor AWS for service restoration.
- monitoring Dec 08, 2021, 01:46 PM UTC
We've restored our notifications system. We'll continue to monitor its health, but are confident we've resolved the issue.
- resolved Dec 08, 2021, 03:59 PM UTC
We've sent out all backlogged notifications, and the solution we've implemented is functioning as expected. This incident has been resolved.