Crossbeam experienced a major incident on October 28, 2022 affecting Web App (app.crossbeam.com) and API (api.crossbeam.com) and 1 more component, lasting 53m. The incident has been resolved; the full update timeline is below.
Affected components
Update timeline
- investigating Oct 28, 2022, 04:15 PM UTC
The Crossbeam backend is currently experiencing an outage. We are investigating the root cause and will provide updates regularly as we find the root cause.
- identified Oct 28, 2022, 04:24 PM UTC
We have identified the cause of the outage. We are working to restore one of our operational databases before the incident. We will be monitoring as we come back online.
- monitoring Oct 28, 2022, 04:39 PM UTC
Crossbeam should be coming back online. We are monitoring the operational database and resolving any background processing.
- resolved Oct 28, 2022, 05:09 PM UTC
The web app and background jobs should now be functioning as normal. The root cause was a regression in the migration library our backend uses that caused an inadvertent drop of our operational schema. We have rolled back the version of this library and introduced additional measures to defend from this situation in the future. Thank you for your patience!