Wakeo incident

Global slow-down on API and Webapp response time

Minor Resolved View vendor source →

Wakeo experienced a minor incident on September 27, 2021 affecting Webapp and API V2, lasting 15h 35m. The incident has been resolved; the full update timeline is below.

Started
Sep 27, 2021, 03:43 PM UTC
Resolved
Sep 28, 2021, 07:19 AM UTC
Duration
15h 35m
Detected by Pingoru
Sep 27, 2021, 03:43 PM UTC

Affected components

WebappAPI V2

Update timeline

  1. investigating Sep 27, 2021, 03:43 PM UTC

    We are currently facing a database performance issue impacting both API and Webapp response time. API request rate has been temporarily throttled to reduce database stress. Engineers are actively working on identifying the issue.

  2. monitoring Sep 27, 2021, 04:31 PM UTC

    The performance issue has been identified by our engineers. A bugfix has been deployed, and we're still monitoring both API and Webapp to ensure there are no other hidden issues. Webhooks have been slowed-down, but will be rescheduled without any loss.

  3. resolved Sep 28, 2021, 07:19 AM UTC

    API request rate limitation was set back to its original value. No other performance issue has been detected over the last few hours. This incident is resolved.