Playbook experienced a critical incident on December 17, 2023 affecting Playbook Web, lasting 5h 29m. The incident has been resolved; the full update timeline is below.
Affected components
Playbook Web
Update timeline
- investigating Dec 18, 2023, 03:36 PM UTC
Playbook Web is not available in all regions. We're investingating an issue.
- investigating Dec 18, 2023, 03:48 PM UTC
We indentified the root cause, and now working on a fix.
- monitoring Dec 18, 2023, 03:49 PM UTC
A fix has been implemented and we are monitoring the results.
- resolved Dec 18, 2023, 03:50 PM UTC
This incident has been resolved.
- postmortem Dec 18, 2023, 05:38 PM UTC
In the early morning hours last night, we hit an issue where our database quickly got overloaded. Our provider blocked connections, which also prevented us from fixing the problem. Escalating to them outside of business hours didn't work. Needless to say, we're taking steps to ensure this won't happen again. We're very sorry for the downtime.