CrystalCommerce experienced a major incident on April 20, 2022 affecting Admin and POS and 1 more component, lasting 14h 11m. The incident has been resolved; the full update timeline is below.
Affected components
Update timeline
- investigating Apr 20, 2022, 06:37 PM UTC
We are seeing 504 and 502 errors while attempting to use CrystalCommerce services, along with slow load times. Our engineering team is currently investigating.
- resolved Apr 21, 2022, 08:49 AM UTC
This incident has been resolved. Our engineers will continue to monitor.
- postmortem Apr 21, 2022, 09:20 AM UTC
We observed 2 large spikes in response time at 9:00am and 11:45am and one lesser spike at 2:2pm \(Pacific Time\), causing 504/502 errors and increased page load times. Although the issue has subsided, our engineering team is working behind the scenes on preventative measures to ensure that this MTG prerelease weekend will go smoothly.  