Nobl9 incident
Alerts, chart data and service health dashboard might be affected.
Nobl9 experienced a major incident on December 26, 2022 affecting Data Intake - Agent stable and beta and Chart Data and 1 more component, lasting 6h 2m. The incident has been resolved; the full update timeline is below.
Affected components
Update timeline
- investigating Dec 26, 2022, 02:08 PM UTC
We are currently investigating an issue with our processing pipeline. Alerts, chart data and service health dashboard might be affected.
- identified Dec 26, 2022, 02:28 PM UTC
The issue has been identified and a fix is being implemented.
- identified Dec 26, 2022, 02:56 PM UTC
Alerts are operational now. We are continuing to work on a fix for the service health dashboard and chart data.
- identified Dec 26, 2022, 03:04 PM UTC
Service health dashboard is operational now. We are continuing to work on a fix for the chart data.
- identified Dec 26, 2022, 03:15 PM UTC
We are still experiencing an issue with our processing pipeline. Alerts might be affected again.
- monitoring Dec 26, 2022, 03:35 PM UTC
A fix has been implemented and we are monitoring the situation.
- monitoring Dec 26, 2022, 04:37 PM UTC
We are still monitoring the situation. Customers using direct integration might experience about 70 minutes (2022-12-26 13:37 UTC - 14:50 UTC) of missing data in charts. We are investigating whether any agent integrations also experienced this issue
- resolved Dec 26, 2022, 08:11 PM UTC
All systems are operational and we are continuing the investigation into data gaps.