DoIT incident

AWS source data problem

Minor Resolved View vendor source →

DoIT experienced a minor incident on February 5, 2024 affecting Cloud Cost Analytics and Dashboards and 1 more component, lasting 18h 2m. The incident has been resolved; the full update timeline is below.

Started
Feb 05, 2024, 04:03 PM UTC
Resolved
Feb 06, 2024, 10:06 AM UTC
Duration
18h 2m
Detected by Pingoru
Feb 05, 2024, 04:03 PM UTC

Affected components

Cloud Cost AnalyticsDashboardsAnomaly Detection

Update timeline

  1. investigating Feb 05, 2024, 04:03 PM UTC

    Multiple customers are seeing double or highly escalated January 2024 billing data compared to their true bill. This issue will be addressed with AWS as soon as possible but is going to delay sending invoices for January 2024.

  2. identified Feb 06, 2024, 07:17 AM UTC

    The root cause of the issue has been identified and the correct data is busy backfilling in our production systems. It should be resolved within 24 hours and all ready AWS invoices should go out on 7 February 2024.

  3. resolved Feb 06, 2024, 10:06 AM UTC

    The AWS incident has been resolved and data quality has returned back to normal.