Nobl9 incident

Charts data and Alerts are available

Major Resolved View vendor source →

Nobl9 experienced a major incident on August 27, 2022 affecting Chart Data and Alerting, lasting 4h 35m. The incident has been resolved; the full update timeline is below.

Started
Aug 27, 2022, 07:48 PM UTC
Resolved
Aug 28, 2022, 12:23 AM UTC
Duration
4h 35m
Detected by Pingoru
Aug 27, 2022, 07:48 PM UTC

Affected components

Chart DataAlerting

Update timeline

  1. investigating Aug 27, 2022, 07:48 PM UTC

    We are currently investigating an issue with our error budget calculation service. Charts data and Alerts are delayed. No data loss is expected.

  2. investigating Aug 27, 2022, 07:49 PM UTC

    We are continuing to investigate this issue.

  3. investigating Aug 27, 2022, 08:33 PM UTC

    We are working on recovery. Live data on charts and alerts are still not available.

  4. monitoring Aug 27, 2022, 09:57 PM UTC

    All Charts data and Alerts are working correctly now and we are monitoring the situation.

  5. resolved Aug 28, 2022, 12:23 AM UTC

    All systems are operating normally since they recovered. We discovered there may be some data loss (30-40 minutes of missing SLI data) for a subset of customers' Direct Data Source SLOs.