Wakeo experienced a minor incident on October 12, 2022, lasting —. The incident has been resolved; the full update timeline is below.
Update timeline
- resolved Oct 12, 2022, 02:49 PM UTC
Our job scheduler suffered an outage this night. It caused no data loss but high latency on webhooks and several other scheduled actions. You may have experienced up to 4h latency on your webhook calls. All pending jobs have now been processed, the situation is back to the normal.
- postmortem Oct 14, 2022, 02:32 PM UTC
### Incident Cause After deeper investigation, we found that this latency was caused by a 3rd-party service’s disruption. This disruption suddenly caused longer processing time on many jobs on our side, and went up to a global high latency on jobs and webhooks calls in the end. ### Actions taken We already have taken immediate actions to mitigate the impact of future 3rd-party service disruptions on our system.