Skytap incident

Storage Degradation in UK-London-M-1

Major Resolved View vendor source →

Skytap experienced a major incident on January 25, 2025 affecting UK-London-M-1 Storage, lasting 52m. The incident has been resolved; the full update timeline is below.

Started
Jan 25, 2025, 08:15 PM UTC
Resolved
Jan 25, 2025, 09:07 PM UTC
Duration
52m
Detected by Pingoru
Jan 25, 2025, 08:15 PM UTC

Affected components

UK-London-M-1 Storage

Update timeline

  1. investigating Jan 25, 2025, 08:15 PM UTC

    We are currently investigating alerts related to a possible storage issue in our UK-London-M-1 Region. We are actively investigating these reports, and will provide further details regarding symptoms and scope within one hour.

  2. identified Jan 25, 2025, 08:36 PM UTC

    We have identified a storage issue in our UK-London-M-1 Region. Our Engineers are actively working on this issue with high priority. Symptoms for this issue may include: - Inability of some Virtual Machines in this region to change state (ie, run, suspend, shutdown) - Degraded disk read/write performance for some running Virtual Machines in this region - Deploying from templates in this region may fail - Saving templates in this region may fail - Copying environments or templates out of this region may fail - VM Imports and Exports out of this region may fail We will provide an additional update within one hour.

  3. monitoring Jan 25, 2025, 08:57 PM UTC

    We have have made preliminary changes to alleviate an issue previously reported hosting services in our UK-London-M-1 Region. Our Engineers continue to work on this issue with high priority. At this time, all of the reported symptoms should now be alleviated: - Inability of some virtual machines in this region to change state (ie, run, suspend, shutdown) - Inability of some running virtual machines in this region to be saved as a template, copied or deleted However, if you have a VM reporting an error or issue, please contact Skytap Support ([email protected]) for assistance.

  4. resolved Jan 25, 2025, 09:07 PM UTC

    The storage issue in our UK-London-M-1 Region has now been resolved. The following symptoms should now be alleviated: - Inability of some Virtual Machines in this region to change state (ie, run, suspend, shutdown) - Degraded disk read/write performance for some running Virtual Machines in this region - Deploying from templates in this region may fail - Saving templates in this region may fail - Copying environments or templates out of this region may fail This disruption may have resulted in some running Virtual Machines being disconnected from their storage for a period of time. Affected VM owners have been notified directly. If you have a VM reporting an error or issue, or if you continue to experience any of the symptoms mentioned above, please contact Skytap Support ([email protected]) for immediate assistance.