Mercatus incident

US Production - Performance degredation

Minor Resolved View vendor source →

Mercatus experienced a minor incident on December 5, 2016, lasting 1h 59m. The incident has been resolved; the full update timeline is below.

Started
Dec 05, 2016, 01:52 PM UTC
Resolved
Dec 05, 2016, 03:52 PM UTC
Duration
1h 59m
Detected by Pingoru
Dec 05, 2016, 01:52 PM UTC

Update timeline

  1. investigating Dec 05, 2016, 01:52 PM UTC

    Currently post release the system performance of US web application is degraded. Engineers are working on a resolution and will continue to update on status.

  2. monitoring Dec 05, 2016, 02:10 PM UTC

    Performance has been restored the issue has been linked with an underperforming database instance. We have triaged and will continue to monitor the database services to avoid future degradation.

  3. investigating Dec 05, 2016, 02:48 PM UTC

    Performance issues with US production are ongoing and be investigated. Engineers are working to restore performance on US instances. All EU instances are unaffected.

  4. resolved Dec 05, 2016, 03:52 PM UTC

    The engineering group has identified the cause of the degraded performance. It has been attributed to a configuration issue which was causing an abundance of call requests to the backend for user task data. We have corrected the interval and the service is now performing within limits.