Is Ubicloud down?

We are investigating reports of degraded performance for Actions and Webhooks

Pages is experiencing degraded performance. We are continuing to investigate.

We continue to investigate delays affecting Actions workflows, Pages deployments, and webhook events, along with errors affecting code search and live updates. We have taken mitigation steps. Actions processing and Pages deployments are showing signs of recovery, but impact has not fully resolved. We are monitoring recovery and investigating the underlying cause.

All affected services have recovered following mitigation. We continue to investigate root cause.

The degradation affecting Actions, Pages and Webhooks has been mitigated. We are monitoring to ensure stability.

This incident has been resolved. Thank you for your patience and understanding as we addressed this issue. A detailed root cause analysis will be shared as soon as it is available.

We're seeing longer than usual wait times for GitHub Actions runners to start, due to high demand. We're investigating and will post updates here.

Wait times are improving. We're processing the remaining backlog and monitoring until queue times are back to normal.

Wait times for GitHub Actions runners are back to normal. Cause: Today we saw a surge in demand that put pressure on our capacity at peak times, especially while EU evenings and US mornings overlapped. This week the overlap is an hour longer than usual because Europe has already switched to winter time and the US hasn't yet. Slowness in Cloudflare R2, which we use for cache storage, also made jobs run longer. This further added to queue times. We're adding capacity to handle a continuous increase in overall demand. We apologize for the delay in processing times.

We investigated the cache slowness. On October 29, Cloudflare had issues on several of their services. From approximately 09:00 to 22:00 UTC, Cloudflare sent our cache traffic to its Prague location instead of Frankfurt, and Cloudflare R2 had increased latency. Because of this, cache upload and download speeds were much lower than normal. Cache performance has been normal since approximately 23:00 UTC on October 29. We are working with Cloudflare to find the root cause, and to prevent and detect similar problems earlier in the future.

API is down at the moment. This incident was automatically created by Instatus monitoring.

API is back up. This incident was automatically resolved by Instatus monitoring.

Console is down at the moment. This incident was automatically created by Instatus monitoring.

Console is back up. This incident was automatically resolved by Instatus monitoring.

We are investigating reports of degraded performance for API Requests, Actions, Issues and Pull Requests

The degradation has been mitigated. We are monitoring to ensure stability.

We saw elevated latency affecting REST API requests, including Checks, and some Actions, Issues, Pull Requests, and GraphQL functionality. Some requests may have been slow or timed out, and notifications were delayed from 17:59 UTC - 18:40 UTC. We mitigated the issue and all services have recovered.

This incident has been resolved. Thank you for your patience and understanding as we addressed this issue. A detailed root cause analysis will be shared as soon as it is available.