Proof incident

Notarize application: degraded performance related to meeting starts and notary functionality

Minor Resolved View vendor source →

Proof experienced a minor incident on October 7, 2021 affecting Notarize Consumer App (iOS) and Proof Consumer (Web) and 1 more component, lasting 1d 5h. The incident has been resolved; the full update timeline is below.

Started
Oct 07, 2021, 05:28 PM UTC
Resolved
Oct 08, 2021, 10:32 PM UTC
Duration
1d 5h
Detected by Pingoru
Oct 07, 2021, 05:28 PM UTC

Affected components

Notarize Consumer App (iOS)Proof Consumer (Web)Notarize Consumer App (Android)Notary Platform

Update timeline

  1. investigating Oct 07, 2021, 05:28 PM UTC

    Notarize application is experiencing degraded performance and increased error rates in the functionality related to RON meeting starts and notary functionality. We are investigating the problem and will send more updates shortly.

  2. monitoring Oct 07, 2021, 08:30 PM UTC

    * The engineering team found the root cause of today's meeting performance problems. It will require an application hotfix to address. We are working on a corresponding change and a test plan. We expect it to deploy to production early next week. * Meanwhile, the team doubled the capacity of our server infrastructure to mitigate this issue short term. * The capacity increase was done around 3:45 pm Eastern time - the application has been behaving normally since then. We will continue monitoring production for the rest of the day.

  3. resolved Oct 08, 2021, 10:32 PM UTC

    We can confirm that short term capacity increase mitigated this issue fully today. Long term application fix will be deployed next week. Closing as resolved. We apologize for the inconvenience and disruption this issue caused.