Thanx incident

Delayed Reporting and Campaign Targeting

Minor Resolved View vendor source →

Thanx experienced a minor incident on March 14, 2025, lasting 5d 15h. The incident has been resolved; the full update timeline is below.

Started
Mar 14, 2025, 12:47 AM UTC
Resolved
Mar 19, 2025, 04:01 PM UTC
Duration
5d 15h
Detected by Pingoru
Mar 14, 2025, 12:47 AM UTC

Update timeline

  1. investigating Mar 14, 2025, 12:47 AM UTC

    We've identified a delay in our dashboard reporting and campaign targeting. This appears to be an issue with AWS infrastructure. We're currently working with AWS's technical team to resolve.

  2. identified Mar 14, 2025, 05:33 AM UTC

    We've identified the root issue and are working on a resolution.

  3. identified Mar 14, 2025, 10:07 AM UTC

    In collaboration with the AWS team, we've that the issue is due to the degradation of the hardware of a key replication database. We are actively working on system restoration. Due to the data scale of the underlying system, data migration is expected to take until EOD Friday.

  4. identified Mar 17, 2025, 06:36 PM UTC

    In collaboration with the AWS team, we've made the changes necessary to our key replication database and are seeing our platform recover. We are closely monitoring its recovery and in parallel also exploring way to further speed up its recovery time if it is technically possible.

  5. monitoring Mar 18, 2025, 01:21 AM UTC

    Our team is in the final stages of recovering full reporting and targeting functionality. We will provide updates periodically as we get closer to full resolution.

  6. resolved Mar 19, 2025, 04:01 PM UTC

    Our database replication has fully caught up and all our reporting data is up to date.