AlertMedia experienced a major incident on December 7, 2021 affecting Web Dashboard & Mobile App and Notifications and 1 more component, lasting 6h 25m. The incident has been resolved; the full update timeline is below.
Affected components
Update timeline
- investigating Dec 07, 2021, 04:41 PM UTC
One of our service providers is currently experiencing some instability. We are investigating the impact on our services.
- investigating Dec 07, 2021, 04:47 PM UTC
We are continuing to investigate the extent of this outage as well as mediation steps.
- investigating Dec 07, 2021, 05:02 PM UTC
We are currently experiencing degraded performance with both notifications and threat warnings due to an ongoing service provider outage. The team is working on mediating these issues. Threat impact is still being calculated and displayed on the map.
- investigating Dec 07, 2021, 05:24 PM UTC
Due to continued issues with our service provider, we are currently experiencing issues creating new threats.
- investigating Dec 07, 2021, 05:51 PM UTC
We are beginning to see improved performance on affected services. We are seeing improvements in Email and SMS notification performance. We are continuing to monitor.
- investigating Dec 07, 2021, 06:04 PM UTC
We are continuing to investigate the impact of our service provider outage and working through several mediation paths currently.
- investigating Dec 07, 2021, 06:18 PM UTC
We are continuing to investigate this issue.
- investigating Dec 07, 2021, 06:58 PM UTC
Notification send & Incoming Message performance has improved significantly. Imports are beginning to process as well. We're beginning to see more service improvements with the affected service provider as well.
- investigating Dec 07, 2021, 07:35 PM UTC
Notification Send, Incoming Messages, Email Triggers, and user Imports continue to improve. We are still working to mediate ongoing issues with our other services.
- investigating Dec 07, 2021, 08:42 PM UTC
Import performance has improved significantly and queued imports are now processing. Threats, Threat Warnings, and Safety Sessions continue to be significantly affected by the service provider outage, and we're continuing to work to mediate this.
- monitoring Dec 07, 2021, 08:55 PM UTC
Import process performance has improved significantly and the queue has decreased to a manageable level. We continue to monitor progress towards a resolution to the ongoing issues related to degraded Threat, Threat Warning, and Saftey/Monitoring performance.
- monitoring Dec 07, 2021, 09:32 PM UTC
Threat Warnings are recovering. We continue to actively monitor our services.
- monitoring Dec 07, 2021, 09:43 PM UTC
Employee Safety Sessions performance is improving. We will continue to monitor this and our other services as they fully recover.
- monitoring Dec 07, 2021, 10:14 PM UTC
All services are operating normally. We're continuing to monitor our services.
- resolved Dec 07, 2021, 11:07 PM UTC
This incident has been resolved.