- Detected by Pingoru
- Jun 27, 2026, 07:00 PM UTC
- Resolved
- Jun 27, 2026, 08:09 PM UTC
- Duration
- 1h 8m
Affected: PostgreSQL
Timeline · 3 updates
-
investigating Jun 27, 2026, 07:29 PM UTC
We are currently investigating issues which mostly impacts Postgres services.
-
monitoring Jun 27, 2026, 08:08 PM UTC
Hetzner experienced a network outage at Falkenstein that affected some of our services: https://status.hetzner.com/incident/49567296-8543-43c1-a0e2-9755ad4bd018
-
resolved Jun 27, 2026, 08:09 PM UTC
The issue should now be resolved. Please let us know if you are still experiencing any problems. We appreciate your patience while we worked to resolve this.
Read the full incident report →
- Detected by Pingoru
- Jun 10, 2026, 05:10 PM UTC
- Resolved
- Jun 11, 2026, 12:11 AM UTC
- Duration
- 7h 1m
Affected: ComputePostgreSQLNetworkingKubernetes
Timeline · 4 updates
-
investigating Jun 10, 2026, 06:52 PM UTC
We are currently investigating and working on fixing the problem.
-
investigating Jun 10, 2026, 06:56 PM UTC
We are continuing to investigate this issue.
-
investigating Jun 10, 2026, 07:56 PM UTC
We experience problems in a subset of the underlying hardware, we are working with the provider to address these issues.
-
resolved Jun 11, 2026, 12:11 AM UTC
All customers have been migrated from affected hardware. If you notice anything out of place, email [email protected]
Read the full incident report →
- Detected by Pingoru
- May 26, 2026, 11:37 AM UTC
- Resolved
- Jun 02, 2026, 06:57 PM UTC
- Duration
- 7d 7h
Affected: GitHub Actions
Timeline · 5 updates
-
investigating May 26, 2026, 11:02 AM UTC
We are investigating reports of slow or failing git checkout and git fetch steps on Ubicloud GitHub Actions runners. Jobs may stall, run very slowly, or time out during the checkout step. We are working to confirm the source.
-
identified May 26, 2026, 11:06 AM UTC
We have traced this to an upstream GitHub issue affecting git data transfer. Connections to GitHub establish normally (DNS, TCP, and TLS are healthy), but transfers stall mid-stream, producing very slow clone and fetch speeds, HTTP/2 stream cancellations, or checkout steps that hang for several minutes. This is occurring across multiple regions and is not specific to Ubicloud infrastructure. The behavior is being reported and tracked by others in the GitHub community here: https://github.com/orgs/community/discussions/196638. We will continue to monitor and update as GitHub addresses the underlying problem. If you need to mitigate in the meantime, the following can help on affected jobs: shallow clones (fetch-depth: 1), forcing HTTP/1.1 (git config --global http.version HTTP/1.1), and adding retry logic around the checkout step.
-
identified May 26, 2026, 11:37 AM UTC
GitHub has a separate, major outage https://www.githubstatus.com/incidents/gnftqj9htp0g
-
identified May 29, 2026, 08:04 AM UTC
We are continuing to work on a fix for this issue.
-
resolved Jun 02, 2026, 06:57 PM UTC
GitHub confirmed that they resolved the issue on their edge servers.
Read the full incident report →
- Detected by Pingoru
- May 19, 2026, 03:05 PM UTC
- Resolved
- May 19, 2026, 05:31 PM UTC
- Duration
- 2h 25m
Affected: GitHub Webhooks
Timeline · 2 updates
-
identified May 19, 2026, 03:05 PM UTC
At approximately 14:55 UTC, we observed a drop in incoming GitHub webhooks as GitHub temporarily stopped sending events. Delivery has since partially recovered. Our system automatically detects missing webhooks every 5 minutes and self-heals by reconciling the missed events. As a result, you may experience longer-than-usual job assignment times until delivery fully stabilizes. We are continuing to monitor the situation.
-
resolved May 19, 2026, 05:31 PM UTC
This incident has been resolved.
Read the full incident report →
- Detected by Pingoru
- May 06, 2026, 07:05 PM UTC
- Resolved
- May 05, 2026, 07:05 PM UTC
- Duration
- —
Affected: Ubicloud Runners
Timeline · 2 updates
-
identified May 05, 2026, 10:24 AM UTC
We're seeing higher than usual demand for our larger runner sizes (16 and 30 vCPUs). This is causing longer than usual provisioning times. We're working to increase our capacity as quickly as possible and mitigate the issue.
-
resolved May 06, 2026, 03:25 AM UTC
Following an initial capacity increase, provisioning times have returned to normal. We're continuing to expand our fleet to meet future demand.
Read the full incident report →
- Detected by Pingoru
- Mar 20, 2026, 10:34 AM UTC
- Resolved
- Mar 20, 2026, 11:00 AM UTC
- Duration
- 25m
Affected: PostgreSQLNetworking
Timeline · 3 updates
-
investigating Mar 20, 2026, 10:34 AM UTC
We are currently investigating issues which mostly impacts Postgres services.
-
investigating Mar 20, 2026, 10:35 AM UTC
We are continuing to investigate this issue.
-
resolved Mar 20, 2026, 11:55 AM UTC
This incident has been resolved.
Read the full incident report →
- Detected by Pingoru
- Mar 06, 2026, 01:58 PM UTC
- Resolved
- Mar 06, 2026, 02:56 PM UTC
- Duration
- 58m
Affected: Ubicloud Runners
Timeline · 2 updates
-
identified Mar 06, 2026, 01:58 PM UTC
Due to an unexpected spike in arm64 demand, there is currently a delay in provisioning arm64 runners. We are working to increase our capacity as quickly as possible to meet the demand and mitigate the issue.
-
resolved Mar 06, 2026, 02:56 PM UTC
This incident has been resolved.
Read the full incident report →
- Detected by Pingoru
- Feb 25, 2026, 09:15 PM UTC
- Resolved
- Feb 25, 2026, 10:50 PM UTC
- Duration
- 1h 34m
Affected: ComputePostgreSQLNetworkingKubernetes
Timeline · 2 updates
-
identified Feb 25, 2026, 09:37 PM UTC
DNS queries can fail sporadically, linked to a UDP-related fault at Hetzner https://status.hetzner.com/incident/5e901309-0873-42af-90c5-84f38304f592 We're monitoring and looking to work around this issue.
-
resolved Feb 25, 2026, 10:55 PM UTC
Caused by a DDOS attack against Hetzner and its mitigation routines. We will be diversifying our DNS upstreams in the future.
Read the full incident report →
- Detected by Pingoru
- Feb 13, 2026, 07:38 PM UTC
- Resolved
- Feb 13, 2026, 08:16 PM UTC
- Duration
- 38m
Affected: ComputePostgreSQLKubernetes
Timeline · 2 updates
-
monitoring Feb 13, 2026, 08:13 PM UTC
Some systems have been restarting erratically due to a recent code change. We backed this out and are recovering.
-
resolved Feb 13, 2026, 08:16 PM UTC
All systems operational again. Write to [email protected] about anything unexpected.
Read the full incident report →
- Detected by Pingoru
- Feb 06, 2026, 08:00 PM UTC
- Resolved
- Feb 06, 2026, 10:13 PM UTC
- Duration
- 2h 13m
Affected: PostgreSQL
Timeline · 5 updates
-
investigating Feb 06, 2026, 08:33 PM UTC
There is a defect in Postgres that causes unbound DNS records. Negative caching can exacerbate the incident after our fix. Databases affected: many at the outset, some now. Diagnosing the last records.
-
monitoring Feb 06, 2026, 09:16 PM UTC
We've hotfixed the remaining records. Negative caching of DNS can slow recovery, depending on the upstream DNS server. We will remain in contact with all affected customer until all symptoms are resolved.
-
identified Feb 06, 2026, 09:35 PM UTC
Some records are proving more difficult to address than we expected.
-
monitoring Feb 06, 2026, 09:41 PM UTC
We've identified this problem, and believe negative caching of DNS records to be all that remains. We are going to continue to check for at least thirty minutes, the longest time reported for negative caching so far.
-
resolved Feb 06, 2026, 10:13 PM UTC
Cross checking DNS records has been successful for some time. Customers report negative caches have since expired. Likely cause: race condition that caused misapplication of DNS records that was exposed under higher parallelism. We have to analyze it and patch it in the coming days.
Read the full incident report →
- Detected by Pingoru
- Jan 26, 2026, 04:30 PM UTC
- Resolved
- Jan 26, 2026, 04:30 PM UTC
- Duration
- —
Timeline · 1 update
-
resolved Feb 09, 2026, 10:06 AM UTC
We are observed temporary networking issues impacting mesh stability and external connectivity.
Read the full incident report →
- Detected by Pingoru
- Jan 19, 2026, 02:26 PM UTC
- Resolved
- Jan 19, 2026, 03:13 PM UTC
- Duration
- 47m
Affected: ComputePostgreSQL
Timeline · 2 updates
-
identified Jan 19, 2026, 02:26 PM UTC
Instances running on this host are currently unreachable. We are actively working to mitigate the issue and restore services. We will keep you updated as we make progress.
-
resolved Jan 19, 2026, 03:13 PM UTC
Our hardware provider has replaced the failed hardware, and all systems are now fully operational.
Read the full incident report →
- Detected by Pingoru
- Dec 15, 2025, 01:37 PM UTC
- Resolved
- Dec 15, 2025, 05:07 PM UTC
- Duration
- 3h 30m
Affected: Ubicloud Runners
Timeline · 3 updates
-
investigating Dec 15, 2025, 01:37 PM UTC
Ubicloud runners are currently experiencing a partial outage, resulting in high queue for job requests. We are investigating the incident.
-
monitoring Dec 15, 2025, 02:11 PM UTC
We've mitigated the issue and are actively monitoring the results. Queue times have started to improve, but due to the high load caused by the incident, some delays are still expected. We’ll share another update once everything is fully resolved. Thank you for your patience.
-
resolved Dec 15, 2025, 05:07 PM UTC
Our provisioning times are back to normal.
Read the full incident report →
- Detected by Pingoru
- Nov 18, 2025, 01:18 PM UTC
- Resolved
- Nov 18, 2025, 02:55 PM UTC
- Duration
- 1h 37m
Timeline · 3 updates
-
identified Nov 18, 2025, 01:18 PM UTC
Ubicloud website uses Cloudflare WAF. The incident https://www.cloudflarestatus.com/incidents/8gmgl950y3h7 is causing downtime on the web pages of Ubicloud.
-
monitoring Nov 18, 2025, 02:44 PM UTC
A fix has been implemented and we are monitoring the results.
-
resolved Nov 18, 2025, 02:55 PM UTC
This incident has been resolved.
Read the full incident report →
- Detected by Pingoru
- Sep 26, 2025, 02:32 PM UTC
- Resolved
- Sep 26, 2025, 03:39 PM UTC
- Duration
- 1h 6m
Affected: GitHub API Requests
Timeline · 2 updates
-
investigating Sep 26, 2025, 02:32 PM UTC
Our monitors have detected an increased number of "503 - github-launch service unavailable" errors from the GitHub API over the past 30 minutes. This affects the time it takes for jobs to be picked up by runners. We believe this may be due to an undeclared GitHub incident and are closely monitoring the situation.
-
resolved Sep 26, 2025, 03:39 PM UTC
GitHub API has stopped returning HTTP 503 errors, and operations are back to normal.
Read the full incident report →
- Detected by Pingoru
- Sep 15, 2025, 05:15 PM UTC
- Resolved
- Sep 16, 2025, 12:13 AM UTC
- Duration
- 6h 57m
Affected: Ubicloud Runners
Timeline · 4 updates
-
investigating Sep 15, 2025, 09:18 PM UTC
We've received several reports of degraded performance when pulling Docker images from ghcr.io. Our team is currently investigating the issue.
-
investigating Sep 15, 2025, 09:31 PM UTC
We have reproduced the issue on virtual machines from other cloud providers. Several other platform providers have reported active incidents with ghcr.io, primarily affecting European clients.
-
monitoring Sep 15, 2025, 11:17 PM UTC
Recent tests show that connectivity with ghcr.io is fast once more. We will continuing monitoring the situation, and if we confirm continued function, will resolve the incident.
-
resolved Sep 16, 2025, 12:13 AM UTC
We have been unable to reproduce the issues with repeated speed tests for an hour. Marking as resolved: please write to [email protected] if you are encountering sustained issues.
Read the full incident report →
- Detected by Pingoru
- Jun 16, 2025, 12:59 PM UTC
- Resolved
- Jun 16, 2025, 04:00 PM UTC
- Duration
- 3h
Affected: Ubicloud Cache
Timeline · 2 updates
-
investigating Jun 16, 2025, 12:59 PM UTC
We’re currently investigating an issue affecting the performance of Ubicloud Cache. You may experience slower cache downloads or occasional timeouts due to degraded performance in the underlying infrastructure. You can email [email protected] if you encounter any issues. We’ll keep you updated as we learn more. Thanks for your patience!
-
resolved Jun 16, 2025, 09:56 PM UTC
Due to intermittent failures on some Cloudflare R2 buckets used for saving cached files, a few users experienced occasional timeouts. Operations appear to be back to normal now.
Read the full incident report →
- Detected by Pingoru
- Jun 05, 2025, 01:53 PM UTC
- Resolved
- Jun 05, 2025, 03:44 PM UTC
- Duration
- 1h 50m
Affected: Ubicloud Runners
Timeline · 2 updates
-
investigating Jun 05, 2025, 01:53 PM UTC
We are currently investigating this issue.
-
resolved Jun 05, 2025, 03:44 PM UTC
Our provisioning times are back to normal.
Read the full incident report →
- Detected by Pingoru
- Apr 30, 2025, 12:15 AM UTC
- Resolved
- May 01, 2025, 09:46 PM UTC
- Duration
- 1d 21h
Affected: ComputePostgreSQLNetworking
Timeline · 4 updates
-
investigating Apr 30, 2025, 02:12 PM UTC
We've detected a number of hosts in one data center in eu-central-h1 have increased packet losses. We will keep you updated.
-
monitoring May 01, 2025, 07:29 AM UTC
The hosts affected by the problem have been fixed.
-
monitoring May 01, 2025, 07:30 AM UTC
We are continuing to monitor for any further issues.
-
resolved May 01, 2025, 09:46 PM UTC
All systems are fully operational.
Read the full incident report →
- Detected by Pingoru
- Mar 21, 2025, 09:39 PM UTC
- Resolved
- Mar 21, 2025, 11:36 PM UTC
- Duration
- 1h 56m
Affected: Ubicloud Cache
Timeline · 3 updates
-
monitoring Mar 21, 2025, 10:12 PM UTC
Cloudflare R2 is currently experiencing a major outage, causing blob storage requests to R2 buckets to fail. As a result, the caches can't be downloaded from Ubicloud Cache service. We are keeping an eye on updates from the Cloudflare team. https://www.cloudflarestatus.com/incidents/v6c7l22vglw5
-
monitoring Mar 21, 2025, 10:57 PM UTC
Cloudflare team deployed a fix and we are monitoring the results
-
resolved Mar 21, 2025, 11:41 PM UTC
The outages have been resolved by Cloudflare team. All operations on Ubicloud cache are back to normal.
Read the full incident report →
- Detected by Pingoru
- Feb 06, 2025, 08:39 AM UTC
- Resolved
- Feb 06, 2025, 09:54 AM UTC
- Duration
- 1h 14m
Affected: Ubicloud Runners
Timeline · 3 updates
-
investigating Feb 06, 2025, 08:39 AM UTC
Cloudflare R2 is currently experiencing a major outage, causing blob storage requests to R2 buckets to fail. As a result, the caches can't be downloaded from Ubicloud Cache service. We are keeping an eye on updates from the Cloudflare team. https://www.cloudflarestatus.com/incidents/pgz7g5xlpxzr Failures while pulling images from DockerHub also started to increase around the same time. It seems that DockerHub was affected by the Cloudflare R2 outage as well. https://www.dockerstatus.com/pages/incident/533c6539221ae15e3f000031/67a479b283fb1305d10af103
-
monitoring Feb 06, 2025, 09:02 AM UTC
We are closely monitoring the incidents created by the Cloudflare R2 and DockerHub teams. - https://www.cloudflarestatus.com/incidents/pgz7g5xlpxzr - https://www.dockerstatus.com/pages/incident/533c6539221ae15e3f000031/67a479b283fb1305d10af103
-
resolved Feb 06, 2025, 09:54 AM UTC
The outages have been resolved by Cloudflare and DockerHub teams. All operations on Ubicloud runners are back to normal.
Read the full incident report →
- Detected by Pingoru
- Nov 12, 2024, 07:48 PM UTC
- Resolved
- Nov 12, 2024, 08:18 PM UTC
- Duration
- 29m
Affected: Ubicloud Runners
Timeline · 2 updates
-
investigating Nov 12, 2024, 07:48 PM UTC
We've detected that some of hosts hitting docker hub pull limit while downloading images. We are investigating the issue. As a workaround logging with your credentials to docker hub can overcome the issue temporarily.
-
resolved Nov 12, 2024, 08:18 PM UTC
Issue has been resolved. You don't need to login with your credentials anymore.
Read the full incident report →
- Detected by Pingoru
- Nov 07, 2024, 04:13 AM UTC
- Resolved
- Nov 07, 2024, 04:36 AM UTC
- Duration
- 23m
Affected: ComputeUbicloud RunnersPostgreSQL
Timeline · 3 updates
-
investigating Nov 07, 2024, 04:13 AM UTC
We've detected a number of hosts in one data center in eu-central-h1 have lost connectivity. We will keep you updated.
-
investigating Nov 07, 2024, 04:31 AM UTC
All the hosts are back online, we're monitoring for anything abnormal as after-effects.
-
resolved Nov 07, 2024, 04:36 AM UTC
All systems operational again.
Read the full incident report →
- Detected by Pingoru
- Nov 06, 2024, 04:35 AM UTC
- Resolved
- Nov 06, 2024, 04:35 AM UTC
- Duration
- —
Timeline · 1 update
-
resolved Nov 06, 2024, 04:45 AM UTC
We identified a momentary interruption in networking in Hetzner-FSN1 that affected a small proportion of virtual machine hosts together, from 4:35 to 4:40 UTC, when networking was restored.
Read the full incident report →
Critical October 30, 2024 - Detected by Pingoru
- Oct 30, 2024, 08:38 AM UTC
- Resolved
- Oct 30, 2024, 09:30 AM UTC
- Duration
- 51m
Affected: Ubicloud RunnersGitHub ActionsGitHub API RequestsGitHub Webhooks
Timeline · 2 updates
-
identified Oct 30, 2024, 08:38 AM UTC
GitHub is currently experiencing a major outage, resulting API request to GitHub Actions endpoints to fail affecting all 3rd party and 1st party Github runner integrations. This results in runners not being assigned to jobs. We are following Github team's updates. https://www.githubstatus.com/incidents/9yk1fbk0qjjc
-
resolved Oct 30, 2024, 09:48 AM UTC
The outage has been resolved by GitHub. All runners on Ubicloud are back to normal.
Read the full incident report →
