Amplience incident

Degraded Dynamic Content performance

Minor Resolved View vendor source →

Amplience experienced a minor incident on August 14, 2024 affecting Dynamic Content, lasting 1h 19m. The incident has been resolved; the full update timeline is below.

Started
Aug 14, 2024, 08:43 PM UTC
Resolved
Aug 14, 2024, 10:03 PM UTC
Duration
1h 19m
Detected by Pingoru
Aug 14, 2024, 08:43 PM UTC

Affected components

Dynamic Content

Update timeline

  1. investigating Aug 14, 2024, 08:43 PM UTC

    We have detected performance issues for Dynamic Content publishing and we are working to mitigate the issues currently. We will send an update when we have further information to share.

  2. investigating Aug 14, 2024, 08:52 PM UTC

    We are continuing to investigate this issue.

  3. investigating Aug 14, 2024, 09:37 PM UTC

    The issue has been mitigated successfully and resolved, we will add any further updates if needed.

  4. resolved Aug 14, 2024, 10:03 PM UTC

    There has been no performance impacting issues noticed since 22:37 GMT. The issue has been mitigated successfully and resolved, we will add any further updates if needed.

  5. postmortem Aug 23, 2024, 04:09 PM UTC

    **Incident Start Date:** 14/08/2024, 19:57 GMT **Incident End Date:** 14/08/2024, 22:37 GMT ‌ **Issue Summary:** On August 14, 2024, an incident occurred within our Dynamic Content service that temporarily impacted the ability to publish content. ‌ **Root Cause:** The disruption was caused by a surge in traffic to the Dynamic Content service, causing delays in content publishing. ‌ **Corrective Actions:** In order to resolve the issue, increases to the workflow limits were implemented supported by the AWS enterprise support team, restoring normal operations, with any impacted publishing jobs reprocessed.