DoControl incident

AWS eventbridge incident

Major Resolved View vendor source →

DoControl experienced a major incident on August 17, 2021 affecting AWS events-us-east-1, lasting 10h 16m. The incident has been resolved; the full update timeline is below.

Started
Aug 17, 2021, 08:16 PM UTC
Resolved
Aug 18, 2021, 06:32 AM UTC
Duration
10h 16m
Detected by Pingoru
Aug 17, 2021, 08:16 PM UTC

Affected components

AWS events-us-east-1

Update timeline

  1. identified Aug 17, 2021, 08:16 PM UTC

    We are seeing aws issues around notifications. this affects internal communication for webhooks including storing raw data and workflows and policies.

  2. identified Aug 17, 2021, 08:16 PM UTC

    We are continuing to work on a fix for this issue.

  3. monitoring Aug 18, 2021, 03:58 AM UTC

    AWS has applied fix to mitigate this incident and stated to backfill the events. the webhooks and workflow seems to work now, we are still monitoring to make sure all system are operational

  4. resolved Aug 18, 2021, 06:32 AM UTC

    This incident has been resolved.