AppOmni had 40 outages in the last 2 years totaling 179h 10m of downtime — averaging 1.6 incidents per month.
There were 40 AppOmni outages since June 7, 2024 totaling 179h 10m of downtime. Each is summarised below — incident details, duration, and resolution information.
We are experiencing degradation of performance for US customers attempting to access the AppOmni console. We are currently investigating the issue.
The degradation of performance for US-based customers has been resolved. We will continue to actively monitor performance to ensure there are no regressions.
We are currently investigating an issue where some customers may experience delays in receiving threat detection alerts.
The issue has been identified and a fix is being implemented.
A fix has been deployed and alert processing has stabilized. We will continue to monitor as the remaining backlog is processed.
Detection alert delivery delays have been resolved. We will continue to monitor for any changes.
This incident has been resolved.
Some customers experienced delayed event delivery due to an edge case that created a backlog and reduced throughput. Mitigation has been implemented, processing capacity increased, and backlog recovery is underway.
We are investigating reports of delayed event delivery to configured destinations.
Recovery is progressing and event delivery performance continues to improve. We are monitoring system stability as backlog processing completes.
Event delivery has returned to normal operating levels. This incident has been resolved.
We are currently investigating an issue where some open posture findings for some of the monitored services are being reported inaccurately. The Posture Findings is still operational. We will provide an update by end of business day
The issue has been identified and fix is being implemented. More updates will be provided soon once the fix is ready to be deployed
The root cause has been identified and a fix has now been rolled out.
We are continuing to monitor for any further issues before marking the incident as resolved
This incident has now been resolved
Customers experienced delayed Threat Detection alerts due to a processing disruption. All events were processed after recovery, no data was lost, and the issue has been resolved.
We are currently investigating an issue with our API Documentation site api.appomni.com There is no impact to the functioning of the APIs
We have contacted the 3rd party service that hosts our API Documentation to help resolve the issue
This incident has been resolved. api.appomni.con is back online. Thank you for your patience.
We are currently investigating an issue related to some ServiceNow instances unable to connect to AppOmni
We are continuing to investigate this issue.
The issue has been identified and we are in the process of determining a fix. The issue has been partially resolved but disconnects may happen again. We are closely monitoring the situation.
Fix has been identified and deployed. The ServiceNow instances are now reconnected. We are currently monitoring the situation closely.
This incident has been resolved. We will continue to closely monitor.
Some customers may have experienced degraded performance across our website and API endpoints. Our team has identified and resolved the issue.
Some customers may have experienced degraded AppOmni console performance and some background tasks may have been delayed
We are currently experiencing service degradation due to a widespread Cloud outage affecting multiple core services. Our systems may be impacted as a result of these upstream issues. We are actively monitoring the situation and will restore full functionality as soon as the underlying problems are resolved.
Most of the Google Cloud products have confirmed full service recovery. There are still a few Google Cloud services experiencing some residual impact, but they are expected to complete recovery in less than an hour. We are continuing to actively monitor the situation and will restore full functionality as soon as the underlying problems are fully resolved.
Google Cloud services have been fully recovered and this incident has been resolved.
We are currently investigating an issue causing login failures to the AppOmni Console. Our team is actively working to identify the root cause and restore functionality as quickly as possible. Updates will be provided here as more information becomes available.
The issue causing login failures to the AppOmni Console has been identified and resolved. All services are now operating normally. Thank you for your patience.
A fix has been implemented and we are monitoring the results.
This incident has been resolved.
Delivery of Threat Detection Events and Alerts is currently delayed. Event collection, processing, and alert analysis is not impacted. All delayed events and alerts will be delivered to configured destinations as soon as possible.
Delivery of Threat Detection Events and Alerts has resumed. Collection, Processing, and alert analysis was not impacted during this degradation. All delayed deliveries are being delivered at this time.
This incident has been resolved.
Threat Log Ingestion on US1 is experiencing severe latency. AppOmni has identified the root cause and has implemented a fix.
We are continuing to monitor for any further issues.
Log Ingestion Latency on US1 is now isolated to M365 Sources.
Latency and backlog now recovered fully for M365 Sources on US1.
This incident has been resolved.
AppOmni Engineering has resolved a brief performance degradation affecting API and console access for some customers in the US region. AppOmni will continue to monitor the system for any additional impacts or recurrences.
AppOmni has identified a brief delay in processing policy scans impacting some customers in the US1 region. These customers may see delayed policy scan processing. Please know that we are actively working on a fix to resolve this issue promptly.
The issue has been identified and a fix is being implemented.
A fix has been implemented and we are monitoring the resolution of delayed policy scans.
This incident has been resolved.
We've resolved a resource constraint issue and are now monitoring a backlog impacting US1 destinations.
This incident has been resolved.
We're observing a higher-than-usual error rate from Microsoft 365, which is impacting the timely ingestion of audit logs from their platform. We will continue to monitor the situation and provide updates as needed.
We're continuing to observe a higher-than-usual error rate from Microsoft 365, which is impacting the timely ingestion of audit logs from their platform. We will continue to monitor the situation and provide updates as needed.
We're continuing to observe higher-than usual error rates from Microsoft 365, however there is no observed disruption in log collection other than a slight increase in latency to ingest.
We are currently experiencing increased replication lag in one of our database replicas, which is causing slower-than-expected data processing for our Threat Detection services. After identifying the root cause, our team is actively rebuilding the affected replica to reduce the lag and restore normal performance. We will continue to provide updates as we progress through the rebuild process.
This incident has been resolved.
We’re aware that there are currently delays in the emission of alerts from our detection engine. Our team is actively investigating the issue and working to resolve it as quickly as possible. We appreciate your patience and will provide further updates as new information becomes available.
We have identified the cause of the delay and implemented a fix. Our team is now restoring normal operations and closely monitoring the situation to ensure everything functions as expected. Thank you for your patience, and we will provide further updates as necessary.
After monitoring, we have confirmed that alert emissions are fully restored and operating as expected. This incident is now resolved.
Some users may have experienced timeouts or slow performance when accessing the console. This issue has now been resolved, and normal functionality has been restored. We apologize for any inconvenience caused and appreciate your patience.
This incident has been resolved.
AppOmni Engineering has identified an infrastructure issue impacting Threat Detection services in the AUS region. Our engineers are actively remediating the issue to restore service at which point delayed data will be ingested and processed normally. We will provide updates as resolution occurs.
AppOmni engineering has resolved the infrastructure issue and AUS region threat detection processes are working normally. Any previously unprocessed data is being processed at this time.
This incident has been resolved.
We are currently experiencing a performance issue with our Single Sign-On (SSO) service. Our team is actively investigating the matter and working to resolve it as quickly as possible.
AppOmni has identified a potential issue with a cloud infrastructure component used as part of our authentication and audit service that is causing intermittent login failures. AppOmni engineering is working to isolate the issue and monitoring our authentication services. There are no security concerns, but users may experience intermittent login failures.
The cloud infrastructure provider has confirmed resolution of their incident, and AppOmni Engineering has monitored decreased errors impacting AppOmni services
Some customers in the US may be experiencing a delay in detection event processing. Our team has identified the issue and is actively working to resolve it. User console, monitoring of service policies, insight scans, and other background operations are not impacted.
The issue has been identified and a fix is being implemented. There is still going to be some delay in processing while we work through the backlog of events.
The fix has been successfully implemented, and processing is now up to date. We will continue to monitor the situation to ensure stability.
This incident has been fully resolved.
AppOmni's IT and Corporate Security teams are investigating an outage of our www.appomni.com site due to a cloud provider's SSL automation
AppOmni has identified the problem as a cloud provider SSL automation issue. We are working with the cloud provider to resolve.
This incident has been resolved.
We are aware of an issue where event collection on US1 is delayed. We are investigating further and will post an update once resolved
A fix has been implemented and we are monitoring. Expect latent events while recovery progresses.
This incident has been resolved.