Shorthand incident

Publishing and story preview intermittent partial page load failure

Resolved after 4 hours 20 minutes, affecting Shorthand and AWS EC2 and 1 more, on December 7, 2021.

resolved Dec 08, 2021, 02:19 AM UTC

All services are now back to full operation, including the slower to resolve Shorthand Analytics service.

Started
Dec 07, 2021, 09:59 PM UTC
Resolved
Dec 08, 2021, 02:19 AM UTC
Duration
4h 20m
Detected by Pingoru
Dec 07, 2021, 09:59 PM UTC

Affected components

ShorthandAWS EC2Marketing

Update timeline

  1. identified Dec 07, 2021, 09:59 PM UTC

    AWS has reported elevated error rates in their EC2 APIs resulting in some Shorthand service issues in publishing and previewing stories. Retrying publishing or reloading previews works intermittently. We are monitoring the situation and working with AWS to address the problem.

  2. monitoring Dec 07, 2021, 11:35 PM UTC

    All affected AWS underlying infrastructure is back to normal, except for Shorthand Analytics which relies on an AWS service still being fully restored (API Gateway). Story publishing, previewing and all other core functionality is back to normal. We will continue to monitor service availability until AWS has fully closed the incident.

  3. resolved Dec 08, 2021, 02:19 AM UTC

    All services are now back to full operation, including the slower to resolve Shorthand Analytics service.

Your product runs on more than Shorthand

Add the vendors you depend on and get one message when any of them reports trouble. Free for 3 vendors, no card.

Add your stack →