Peakon incident

Increased dashboard error rates and delayed job processing

Minor Resolved View vendor source →

Peakon experienced a minor incident on July 2, 2020 affecting Dashboard and Survey and 1 more component, lasting 6h 13m. The incident has been resolved; the full update timeline is below.

Started
Jul 02, 2020, 02:19 PM UTC
Resolved
Jul 02, 2020, 08:33 PM UTC
Duration
6h 13m
Detected by Pingoru
Jul 02, 2020, 02:19 PM UTC

Affected components

DashboardSurveyAPI

Update timeline

  1. investigating Jul 02, 2020, 02:19 PM UTC

    We are experiencing increased error rates in the web application and delayed processing. We are currently working to identify the root cause of the issue.

  2. monitoring Jul 02, 2020, 04:01 PM UTC

    We had some issues with one of our underlying data stores. We will continue to monitor the situation.

  3. monitoring Jul 02, 2020, 08:33 PM UTC

    We have provisioned additional resources to better manage the increased load causing this incident. All systems are back to operating normally again.

  4. resolved Jul 02, 2020, 08:33 PM UTC

    This incident has been resolved.