Wakeo experienced a major incident on October 13, 2021 affecting Webapp and API V2, lasting 3h 21m. The incident has been resolved; the full update timeline is below.
Affected components
Update timeline
- investigating Oct 13, 2021, 02:40 PM UTC
We are currently facing a database performance issue impacting some Webapp pages response time. API request rate has been temporarily throttled to reduce database stress, but should not be impacted. Engineers are actively working on identifying the issue.
- investigating Oct 13, 2021, 03:00 PM UTC
API is now impacted, and timeouts may occurs. Engineers are still working on identifying the issue.
- investigating Oct 13, 2021, 03:51 PM UTC
Emergency actions have been taken to free database memory, timeouts should not occur anymore. Issue possible origins amount has been narrowed, but not clearly identified. We'll actively monitor our database metrics to gather more informations.
- investigating Oct 13, 2021, 04:06 PM UTC
API request rate throttling has been removed. Database remains under active monitoring.
- resolved Oct 13, 2021, 06:01 PM UTC
No timeouts have been detected over the last few hours. Although we consider this incident as resolved, database will remains under active monitoring.