Gitpod experienced a minor incident on March 8, 2023 affecting [PAYG] Workspaces, lasting 8h 39m. The incident has been resolved; the full update timeline is below.
Affected components
Update timeline
- investigating Mar 08, 2023, 07:44 AM UTC
We've detected, and received reports, of workspaces stuck in pulling image. We're investigating the cause of this issue.
- investigating Mar 08, 2023, 07:55 AM UTC
The issue looks to only affect Large workspaces. For now, we've cordoned our EU workspace cluster, and are scheduling workspaces in US. Affected users should be able to create new workspaces now (but will be in the US region).
- investigating Mar 08, 2023, 08:18 AM UTC
Traffic shift to the US is working correctly and Large Workspaces can be started there. We're continuing to identify the root cause of the EU workspace cluster Image Pull degradation.
- investigating Mar 08, 2023, 08:37 AM UTC
We've completed rebuilding the EU workspace cluster, and we're starting to shift EU traffic to this cluster now. Already running workspaces will continue to run in the US, until they are restarted, at which point the nearest geographical region will be used.
- monitoring Mar 08, 2023, 08:50 AM UTC
EU workspace cluster looks to be operating correctly, we continue monitoring.
- resolved Mar 08, 2023, 04:24 PM UTC
This incident has been resolved.