Skytap experienced a major incident on April 30, 2025 affecting SG-Singapore-M-1 Storage, lasting 1h 52m. The incident has been resolved; the full update timeline is below.
Affected components
Update timeline
- investigating Apr 30, 2025, 12:12 PM UTC
We are currently investigating alerts related to a possible storage issue in our SG-Singapore-M-1 Region. We are actively investigating these reports, and will provide further details regarding symptoms and scope within one hour.
- identified Apr 30, 2025, 12:36 PM UTC
We have identified a storage issue in our SG-Singapore-M-1 Region. Our Engineers are actively working on this issue with high priority. Symptoms for this issue may include: - Inability of some Virtual Machines in this region to change state (ie, run, suspend, shutdown) - Degraded disk read/write performance for some running Virtual Machines in this region - Deploying from templates in this region may fail - Saving templates in this region may fail - Copying environments or templates out of this region may fail - VM Imports and Exports out of this region may fail We will provide an additional update within one hour.
- monitoring Apr 30, 2025, 01:31 PM UTC
We have have made preliminary changes to alleviate an issue previously reported hosting services in our SG-Singapore-M-1 Region. Our Engineers continue to work on this issue with high priority. At this time, all of the reported symptoms should now be alleviated: - Inability of some virtual machines in this region to change state (ie, run, suspend, shutdown) - Inability of some running virtual machines in this region to be saved as a template, copied or deleted However, if you have a VM reporting an error or issue, please contact Skytap Support ([email protected]) for assistance.
- resolved Apr 30, 2025, 02:04 PM UTC
The storage issue in our SG-Singapore-M-1 Region has now been resolved. The following symptoms should now be alleviated: - Inability of some Virtual Machines in this region to change state (ie, run, suspend, shutdown) - Degraded disk read/write performance for some running Virtual Machines in this region - Deploying from templates in this region may fail - Saving templates in this region may fail - Copying environments or templates out of this region may fail This disruption may have resulted in some running Virtual Machines being disconnected from their storage for a period of time. Affected VM owners have been notified directly. If you have a VM reporting an error or issue, or if you continue to experience any of the symptoms mentioned above, please contact Skytap Support ([email protected]) for immediate assistance.