Thought Industries incident

AWS Firehose Outage

Minor Resolved View vendor source →

Thought Industries experienced a minor incident on July 30, 2024 affecting US - Platform, lasting 5h 46m. The incident has been resolved; the full update timeline is below.

Started
Jul 30, 2024, 10:58 PM UTC
Resolved
Jul 31, 2024, 04:45 AM UTC
Duration
5h 46m
Detected by Pingoru
Jul 30, 2024, 10:58 PM UTC

Affected components

US - Platform

Update timeline

  1. monitoring Jul 30, 2024, 10:58 PM UTC

    AWS is experiencing increased error rates on their Firehose service which impacts some specific activity tracking & reporting on the platform. We will be carefully monitoring the situation until resolution. See AWS's status page for details: https://health.aws.amazon.com/health/status

  2. resolved Jul 31, 2024, 04:45 AM UTC

    AWS has resolved the outage. Accuracy of some activity-based reporting will be impacted for the active period of the outage.

  3. postmortem Jul 31, 2024, 07:30 PM UTC

    Between 2024-07-30 21:45 UTC and 2024-07-31 4:10 UTC AWS experienced an internal outage which impacted several delivery streams for activity-related reporting on the Thought Industries platform. Despite the failure, posted data was successfully stored in S3 for future ingestion and was successfully re-processed at the conclusion of the outage - there should be no lasting inaccuracies in reporting as a result of this incident.