SKULabs experienced a major incident on June 19, 2023 affecting SKULabs App, lasting 1h. The incident has been resolved; the full update timeline is below.
Affected components
Update timeline
- monitoring Jun 19, 2023, 03:33 PM UTC
The origin of the errors has been identified and a fix is being deployed.
- monitoring Jun 19, 2023, 03:38 PM UTC
We are continuing to monitor for any further issues.
- monitoring Jun 19, 2023, 03:39 PM UTC
We are continuing to monitor for any further issues.
- resolved Jun 19, 2023, 04:34 PM UTC
This incident has been resolved.
- postmortem Jun 20, 2023, 11:41 PM UTC
A limitation in our deployment architecture prevented SKULabs from safely booting. As a result of this type of outage, we have now implemented auto-failover to [next.skulabs.com](http://next.skulabs.com) seamlessly for all users of [app.skulabs.com](http://app.skulabs.com) when [app.skulabs.com](http://app.skulabs.com) becomes unavailable. This should increase our durability even through release-related or other major outages at AWS.