Crunch.io experienced a major incident on December 8, 2020 affecting Crunch.io Web Application and API and Dataset Streaming, lasting 1d 4h. The incident has been resolved; the full update timeline is below.
Affected components
Update timeline
- investigating Dec 08, 2020, 05:37 PM UTC
We are seeing a small increase in the number of server errors, and are working to route requests away from the host(s) that appear responsible.
- investigating Dec 08, 2020, 07:48 PM UTC
For a short period of time, actions that changed datasets — creating, editing variables, joining, etc. — were blocked by an integrity-check that incorrectly flagged some datasets as potentially damaged. We have since reverted the change that introduced the over-zealous check, and are working to restore access to those datasets (and ability to edit).
- identified Dec 08, 2020, 10:00 PM UTC
We have identified a fix for the incident, and are collecting information on datasets that were affected so access and editing of them can be restored.
- monitoring Dec 09, 2020, 03:08 AM UTC
Most datasets that were affected have been restored. A few need more work to restore which will resume tomorrow.
- resolved Dec 09, 2020, 10:29 PM UTC
The incident has been resolved. All affected datasets are now accessible and editable.