Block 64 incident
BlockBox Discovery Appliance Networking Failure
Block 64 experienced a major incident on March 15, 2022 affecting Block 64 Discovery Appliance, lasting 41d 1h. The incident has been resolved; the full update timeline is below.
Affected components
Update timeline
- identified Mar 15, 2022, 04:04 PM UTC
A 3rd party service running on the BlockBox Discovery Appliance, intended for cross-hypervisor-compatibility, has been automatically replacing the preferred, generic, Linux kernel. The newly installed kernel does not have VMware network adapter drivers available, thus causing a networking failure on VMware-based deployments. The failure can be mitigated by replacing the included network adapter (using VMware's VMXNet3 driver) with one using the E1000 driver. For the steps to go through this mitigation, visit https://support.block64.com/kb/march-2022-blockbox-networking If there are questions or concerns, please contact us at [email protected]
- monitoring Mar 28, 2022, 08:22 PM UTC
A fix has been implemented and we are monitoring the results.
- resolved Apr 25, 2022, 05:26 PM UTC
This incident has been resolved.