Peakon incident

Elevated response times and error rates

Minor Resolved View vendor source →

Peakon experienced a minor incident on February 14, 2023 affecting Dashboard and Survey and 1 more component, lasting 4h 4m. The incident has been resolved; the full update timeline is below.

Started
Feb 14, 2023, 10:10 AM UTC
Resolved
Feb 14, 2023, 02:14 PM UTC
Duration
4h 4m
Detected by Pingoru
Feb 14, 2023, 10:10 AM UTC

Affected components

DashboardSurveyAPI

Update timeline

  1. investigating Feb 14, 2023, 10:10 AM UTC

    We are currently investigating this issue.

  2. resolved Feb 14, 2023, 02:14 PM UTC

    This incident has been resolved.

  3. postmortem Feb 14, 2023, 02:28 PM UTC

    We had a high amount of incoming requests to several endpoints, which were not rate limited, and generated a heavy load on our application. This caused an increase in latency and errors due to the request timeouts. The issues were resolved once the rate limiting was enabled for those endpoints.