Gitpod incident
Workspace public ports are unavailable and IDE PORTS-UI anomalies
Gitpod experienced a major incident on May 2, 2023 affecting [PAYG] Workspaces, lasting 15h 54m. The incident has been resolved; the full update timeline is below.
Affected components
Update timeline
- investigating May 02, 2023, 01:32 AM UTC
We've spotted that something has gone wrong with our ports mechanism. We're currently investigating the issue, and will provide an update soon. Ports visibility can't be set to public from the IDE-UI (e.g. vscode) or `gp ports` CLI command. Some users also reported that the IDE-UI (e.g. vscode) PORTS panel infinitely shows "detecting..." after each open port.
- investigating May 02, 2023, 02:44 AM UTC
We are able to reliably reproduce the issues. The incident has been escalated and now awaiting for a fix.
- investigating May 02, 2023, 04:16 AM UTC
Only US workspaces are affected. EU clusters remains unaffected.
- identified May 02, 2023, 05:36 AM UTC
We have found that the new generation clusters do not include exposed ports information. We are rolling back and will be fixing it in the new clusters.
- monitoring May 02, 2023, 06:08 AM UTC
US and EU clusters have been rolled back, and ports detection should be working as expected on both.
- resolved May 02, 2023, 05:27 PM UTC
Ports detection working normally in all clusters.