Amplience incident

VSE Issue under investigation

Minor Resolved View vendor source →

Amplience experienced a minor incident on December 1, 2024 affecting Dynamic Media, lasting 3h 32m. The incident has been resolved; the full update timeline is below.

Started
Dec 01, 2024, 07:32 PM UTC
Resolved
Dec 01, 2024, 11:05 PM UTC
Duration
3h 32m
Detected by Pingoru
Dec 01, 2024, 07:32 PM UTC

Affected components

Dynamic Media

Update timeline

  1. investigating Dec 01, 2024, 07:32 PM UTC

    We are currently investigating an issue with VSEs which may experience degraded performance

  2. investigating Dec 01, 2024, 07:56 PM UTC

    We have found and resolved the issue

  3. resolved Dec 01, 2024, 11:05 PM UTC

    The incident was resolved at 19:56 and no further issues were seen.

  4. postmortem Dec 04, 2024, 10:13 AM UTC

    **Incident Report** **Incident Start Date:** 01/12/2024 17:50 **Incident End Date:** 01/12/2024 19:56 **Summary** On the evening of December 1st, our monitoring systems detected degraded performance in our Virtual Staging Environment. During this time, some customers may have encountered 5XX errors when previewing images. It is important to note that this issue was isolated to image previews and **did not** impact the dynamic image service. **Root Cause** The disruption was triggered by an unexpected surge in traffic to our Virtual Staging Environment. **Resolution** To resolve the issue, we promptly scaled up the service to handle the increased load.