GoFormz incident
Degraded Performance with GoFormz Forms and Template services
GoFormz experienced a minor incident on January 10, 2020 affecting Web App and Automated Workflows, lasting 17h 45m. The incident has been resolved; the full update timeline is below.
Affected components
Update timeline
- investigating Jan 10, 2020, 12:24 AM UTC
We are currently investigating an issue that is impacting Forms and Template pages. Our engineers are working with Azure support to determine the root cause.
- monitoring Jan 10, 2020, 12:54 AM UTC
After troubleshooting with Azure Support, Forms and Template services have returned to normal operation. We will continue to work with Azure Support to determine the root cause and update this issue upon such findings.
- resolved Jan 10, 2020, 06:09 PM UTC
This incident has been resolved.
- postmortem Jan 10, 2020, 11:33 PM UTC
After review and consultation with Microsoft Azure support, it was determined that an Azure platform event, occurring shortly before GoFormz experienced degraded performance, triggered an application recycle leading to instability with our Forms, Template, and Auth services. Azure support has provided GoFormz engineering and ops teams with specific mitigation steps to more quickly resolve any impact to our services if a future similar platform event occurs.