Crusoe incident

Certain VM's in us-east1-a region are unavailable

Major Resolved View vendor source →

Crusoe experienced a major incident on May 30, 2025 affecting us-east1, lasting 3h 46m. The incident has been resolved; the full update timeline is below.

Started
May 30, 2025, 01:05 PM UTC
Resolved
May 30, 2025, 04:52 PM UTC
Duration
3h 46m
Detected by Pingoru
May 30, 2025, 01:05 PM UTC

Affected components

us-east1

Update timeline

  1. investigating May 30, 2025, 01:05 PM UTC

    We are currently investigating a potential service interruption that may impact some customers in our us-east1-a region. If you are experiencing issues in this region, please reach out to [email protected]

  2. investigating May 30, 2025, 01:18 PM UTC

    We are continuing to investigate this issue.

  3. investigating May 30, 2025, 01:32 PM UTC

    We are currently investigating an issue impacting virtual machine accessibility in us-east1-a region. Some users may be unable to access their VMs at this time. We appreciate your patience and will provide updates as more information becomes available.

  4. investigating May 30, 2025, 01:33 PM UTC

    We are continuing to investigate this issue.

  5. investigating May 30, 2025, 01:34 PM UTC

    We are continuing to investigate this issue.

  6. investigating May 30, 2025, 01:44 PM UTC

    We are continuing to investigate this issue.

  7. investigating May 30, 2025, 03:24 PM UTC

    We're making significant progress in resolving the virtual machine accessibility issues in the us-east1-a region. We apologize for the continued disruption and thank you for your patience as we work to restore full service. We will provide another update as soon as more information is available or when services are fully restored. You can continue to contact our support team at [email protected], if there are any other concerns to address

  8. monitoring May 30, 2025, 03:55 PM UTC

    We have identified and mitigated the underlying cause. Although no further impact is expected, we are continuing to monitor. If you are still experiencing issues, please reach out to us through [email protected] and we will investigate further.

  9. monitoring May 30, 2025, 03:55 PM UTC

    We are continuing to monitor for any further issues.

  10. monitoring May 30, 2025, 04:45 PM UTC

    A fix has been applied and the outage has been mitigated. Services have returned to normal operations in us-east1-a region. We are continuing to monitor the situation and validate preventive measures. Please contact [email protected] if you are still experiencing any issues.

  11. resolved May 30, 2025, 04:52 PM UTC

    This incident has been resolved.