Amplience incident

Unable to publish content or preview

Major Resolved View vendor source →

Amplience experienced a major incident on September 5, 2023 affecting Dynamic Content, lasting 23m. The incident has been resolved; the full update timeline is below.

Started
Sep 05, 2023, 02:20 PM UTC
Resolved
Sep 05, 2023, 02:44 PM UTC
Duration
23m
Detected by Pingoru
Sep 05, 2023, 02:20 PM UTC

Affected components

Dynamic Content

Update timeline

  1. identified Sep 05, 2023, 02:20 PM UTC

    We restored service to our Authentication service but we are seeing users impacted using Virtual Staging Environments (Preview) and Scheduling content. Our Engineering team are continuing to investigate.

  2. monitoring Sep 05, 2023, 02:33 PM UTC

    A fix has been implemented and we are monitoring the results.

  3. resolved Sep 05, 2023, 02:44 PM UTC

    This incident has been resolved.

  4. postmortem Sep 07, 2023, 09:57 AM UTC

    # **Summary** On Tuesday, September 5th, we experienced a failed deployment of an SSL certificate which impacted our platform. This caused our customers to experience difficulties generating an authentication token alongside being unable to publish or preview content # **Root Cause** We carried out a standard change \(pre-authorized and low-risk\) of renewing our certificate. However, the intermediate certificate was missing during the process, which meant our internal services couldn’t connect to [auth.amplience.net](http://auth.amplience.net/) to get a token. The certificate was redeployed on our infrastructure to restore the service # **Corrective and Preventive Measures** Internally, we are exploring ways to automate and upgrade our services so we can avoid this issue going forward ‌ If you would like to discuss this further, please contact your customer success manager \([[email protected]](mailto:[email protected])\)