Adeptcore experienced a major incident on January 5, 2023 affecting ACP - Nodes, lasting 77d 1h. The incident has been resolved; the full update timeline is below.
Affected components
Update timeline
- investigating Jan 05, 2023, 04:02 PM UTC
We are currently experiencing issues with a single host at our PHX datacenter that experienced an outage. This host is currently coming back up. We expect the host and all VM's to be back online shortly and will provide an update in 15 minutes.
- monitoring Jan 05, 2023, 04:12 PM UTC
We have powered on the host and are currently working on bringing the VM's online. We will update once this process has been completed. If you have submitted a ticket you will also be notified in the ticket once your machines are online.
- monitoring Jan 05, 2023, 04:41 PM UTC
The last of the VM's have been brought online and are being migrated to different hosts to allow for investigation as to the cause of this issue. We will have a report as to the cause in the coming days. If your VM's still show offline, please give them a few minutes before checking again. If you continue to have issues please submit a ticket by emailing [email protected]
- monitoring Jan 05, 2023, 07:10 PM UTC
We are continuing to monitor for any further issues.
- resolved Mar 23, 2023, 05:06 PM UTC
host was brought back online and was confirmed to be faulty hardware in the host. This hardware has been replaced and the host has been operating without incident