Omnilert experienced a major incident on December 7, 2021 affecting Administrator Portal and CAP and 1 more component, lasting 10h 19m. The incident has been resolved; the full update timeline is below.
Affected components
Update timeline
- identified Dec 07, 2021, 04:10 PM UTC
Omnilert is aware of an ongoing issue with our service provider. This may impact access to some services and messaging capabilities. We will update this status message as more information and/or a resolution become available.
- identified Dec 07, 2021, 05:53 PM UTC
We continue to see intermittent issues with Omnilert services due to the ongoing system outages at AWS. Omnilert engineers will monitor this situation and we will update this status page as soon as more information becomes available.
- identified Dec 07, 2021, 09:05 PM UTC
We are noticing improvement in services as AWS works to restore connectivity. We will continue to monitor for updates to this ongoing issue.
- resolved Dec 08, 2021, 02:30 AM UTC
Omnilert engineers have determined that all downstream issues affecting Omnilert have been resolved. All Omnilert systems are operating normally.
- postmortem Dec 08, 2021, 07:26 PM UTC
We have completed our review of the incident from 12/07/2021 and determined that the issue was the result of a large-scale outage at our primary host provider, Amazon Web Services \(AWS\). This is the same AWS service outage that affected much of the Internet and made international news. As Omnilert's services are hosted on AWS, we were also impacted. This outage was expansive enough that it limited our ability to mitigate the interruption to our services. AWS has since rectified the issues and all systems have returned to normal operations. We have been assured that Amazon is researching this incident and we are also looking into ways to mitigate any future issue of this kind. Please know that we take these incidents very seriously and are always here if you have any questions. Sincerely, Scott Howard Director, Omnilert Support [email protected]