ClickHouse Outage History
ClickHouse is up right nowPingoru has recorded 64 incidents for ClickHouse: 62 in the last 12 months and 15 in the last 90 days.
Show as a table
| Month | Incidents | Hours with an open incident |
|---|---|---|
| April 2026 | 9 | 92 of 720 (13%) |
| May 2026 | 6 | 167 of 744 (22%) |
| June 2026 | 2 | 100 of 720 (14%) |
| July 2026 | 6 | 16 of 744 (2%) |
| August 2026 | 4 | 8 of 744 (1%) |
| September 2026 | 8 | 40 of 720 (6%) |
| October 2026 | 3 | 10 of 587 (2%) |
Incidents, newest first
Minor May 22, 2026 Capacity issues in AWS us-east-1 region affecting provisioning times 39m us-east-1, us-east-1
Started May 22, 2026, 04:11 PM UTC· resolved May 22, 2026, 04:50 PM UTC
- identified May 22, 2026, 04:11 PM UTC
We've noticed some instances are stuck in provisioning state due to capacity issues in AWS us-east-1 region. ClickHouse Cloud team is working on possible remediations, but we advise do not create new instances in this region until capacity problem is addressed on AWS side.
- resolved May 22, 2026, 04:50 PM UTC
Affected instances have been corrected in the AWS us-east-1 region. We apologize for the disruption this issue caused. We are committed to the reliability of all ClickHouse Cloud services and appreciate your understanding as we continue to improve our systems and operations. If you have questions or need information on a specific ClickHouse service, please contact support "contact support": https://clickhouse.cloud/support.
Minor May 18, 2026 GCP us-east1 capacity constraints impacting cluster operations 2d 6h us-east1
Started May 18, 2026, 12:31 PM UTC· resolved May 20, 2026, 06:32 PM UTC
- investigating May 18, 2026, 12:31 PM UTC
We are currently experiencing capacity constraints in the affected GCP region. As a result, users may encounter issues when creating new clusters or operating existing clusters in this region. Our team is actively working on mitigation to restore normal capacity and minimize customer impact. We will continue to provide updates as more information becomes available.
- resolved May 20, 2026, 06:32 PM UTC
No more capacity issues observed for us-east1 region. Provisioning and scaling should work as usual.
Minor May 8, 2026 Increased Error Rate and Latency on AWS Region (US-EAST-1) 1d 7h us-east-1, us-east-1
Started May 08, 2026, 02:46 AM UTC· resolved May 09, 2026, 09:48 AM UTC
- investigating May 08, 2026, 02:46 AM UTC
AWS Region (US-EAST-1) is experiencing disruptions. We are actively monitoring the situation and following updates from AWS. Please follow the https://health.aws.amazon.com/health/status page for latest updates.
- resolved May 09, 2026, 09:48 AM UTC
AWS has mitigated the disruption affecting the US-EAST-1 availability zone. We will continue monitoring to ensure stability.
Minor May 5, 2026 Azure new services impacted 2h 10m westus3
Started May 05, 2026, 01:03 PM UTC· resolved May 05, 2026, 03:14 PM UTC
- investigating May 05, 2026, 01:03 PM UTC
We are currently experiencing issues provisioning new services in Azure. Existing services are not impacted.
- resolved May 05, 2026, 03:14 PM UTC
We have resolved the issue and are no longer seeing impact to services
Minor April 28, 2026 Degraded connectivity affecting us-east-2 1d 7h us-east-2, us-east-2
Started Apr 28, 2026, 06:44 PM UTC· resolved Apr 30, 2026, 02:12 AM UTC
- investigating Apr 28, 2026, 06:44 PM UTC
We are currently investigating connection issues affecting some customers, resulting in connection timeouts when connecting to ClickHouse. The issue has been isolated to infrastructure in the us-east-2 region. We have received multiple high-severity reports and are treating this with priority. Our engineering team is actively working to mitigate the issue and restore normal connectivity. We will provide further updates as more information becomes available.
- monitoring Apr 28, 2026, 07:18 PM UTC
The connection issues affecting some customers in the us-east-2 region have been mitigated, and services are currently operating normally. We are continuing to monitor the situation closely to ensure stability and prevent recurrence. We will provide further updates if there are any changes.
- resolved Apr 28, 2026, 07:41 PM UTC
The connection issues affecting some customers in the us-east-2 region have been resolved, and services are operating normally.
- investigating Apr 28, 2026, 08:34 PM UTC
We are seeing a recurrence of the connection issues affecting some customers in the us-east-2 region, resulting in connection timeouts. Our team is actively investigating and working to mitigate the issue as a priority. We will provide further updates as more information becomes available.
- monitoring Apr 28, 2026, 10:32 PM UTC
A subset of services in us-east-2 experienced intermittent connection timeouts earlier today caused by exhaustion of network resources on one of our regional load balancers. We have applied mitigations to restore connectivity and the service is currently operating normally. We are continuing to work with on rolling out additional capacity and safeguards to prevent recurrence. Customers who continue to see connection issues should reach out to support.
- resolved Apr 30, 2026, 02:12 AM UTC
We have resolved the incident.
Minor April 19, 2026 Capacity constraints for new workloads on GCP us-east1 1d 8h us-east1
Started Apr 19, 2026, 01:39 PM UTC· resolved Apr 20, 2026, 10:18 PM UTC
- identified Apr 19, 2026, 01:39 PM UTC
We are experiencing capacity constraints for new workloads on GCP us-east1. Currently running and created instances are not affected.
- identified Apr 19, 2026, 02:29 PM UTC
Capacity constraints of GCP us-east1 region do not allow to allocate more instances in the region. We are working with a cloud provider to resolve capacity issues. Running services are working without issues, but new instance creation is disabled.
- resolved Apr 20, 2026, 10:18 PM UTC
Incident has been resolved
Minor April 17, 2026 Degraded provisioning times and slower scaling opreations in GCP us-central1 region 20h 1m
Started Apr 17, 2026, 03:12 PM UTC· resolved Apr 18, 2026, 11:13 AM UTC
No vendor updates were posted for this incident.
Minor April 16, 2026 Unable to edit service scaling settings and delete services 1h 44m asia-southeast1, ap-south-1, us-east-1, ap-southeast-2 and 27 more
Started Apr 16, 2026, 10:11 PM UTC· resolved Apr 16, 2026, 11:55 PM UTC
- identified Apr 16, 2026, 10:11 PM UTC
Impacting services on ClickHouse Cloud across multiple regions.
- monitoring Apr 16, 2026, 11:55 PM UTC
Fix is rolled out on all regions
- resolved Apr 16, 2026, 11:55 PM UTC
Fix has been applied on all regions.
Minor April 8, 2026 Creation of new instances in AWS is delayed or stuck 6h 15m ap-south-1, us-east-1, ap-southeast-2, ap-northeast-1 and 19 more
Started Apr 08, 2026, 04:09 PM UTC· resolved Apr 08, 2026, 10:24 PM UTC
- investigating Apr 08, 2026, 04:09 PM UTC
We spotted an issue where creation of new ClickHouse instances is delayed or stuck. Team is investigating the issue and already applying a temporary remediation.
- identified Apr 08, 2026, 04:21 PM UTC
We identified the issue and applying the remediation. The issue was caused by manual operation performed on the AWS Route53 configuration earlier today. It caused increase in the rate of requests to Route53 API, leading to throttling and retries (including provisioning of new ClickHouse instances).
- monitoring Apr 08, 2026, 04:49 PM UTC
We applied the fix for a subset of regions and see signs of improvements. We are gradually applying the fix to all other regions and monitoring the status.
- monitoring Apr 08, 2026, 07:20 PM UTC
ClickHouse continues to scale external-dns in each region. The following regions are complete and operating normally: us-east-1, af-south-1, ap-east-1, ap-northeast-1, ap-northeast-2, ap-south-1 Additional regions are in progress or will begin shortly, and the ETA to complete the remaining regions is estimated as 3-5 hours: us-east-2, us-west-2, eu-central-1, eu-west-1, eu-west-2, ap-southeast-1, ap-southeast-2, il-central-1
- resolved Apr 08, 2026, 10:24 PM UTC
This issue is resolved. External-DNS has been scaled for all impacted regions.
Minor March 16, 2026 ClickStack UI is not loading 1h 31m SQLConsole
Started Mar 16, 2026, 11:28 AM UTC· resolved Mar 16, 2026, 12:59 PM UTC
- investigating Mar 16, 2026, 11:28 AM UTC
The ClickStack UI (https://hyperdx.clickhouse.cloud/) is currently not loading. We are investigating.
- resolved Mar 16, 2026, 12:59 PM UTC
The incident was caused by an overloaded database. The instance was scaled up. It is stable again now. We are investigating heavy queries and will apply improvements.
Minor March 3, 2026 Resolved – Operational Impact in ClickPipes 2h 20m AWS us-east-2, AWS us-east-1
Started Mar 03, 2026, 08:39 AM UTC· resolved Mar 03, 2026, 11:00 AM UTC
- investigating Mar 03, 2026, 08:39 AM UTC
We are currently experiencing degraded operational performance in ClickPlane. Data ingestion is functioning as expected, however some operational features may experience increased latency or intermittent behavior. Our team is actively investigating the issue and working on mitigation. We will provide further updates as soon as more information becomes available.
- identified Mar 03, 2026, 10:04 AM UTC
We have mitigated the impact affecting ClickPlane in the us-east-1 region. Operational performance in this region has stabilized, and ingestion continues to function normally. We are continuing to monitor the system closely to ensure stability and working to fix the problem on us-east-2
- identified Mar 03, 2026, 10:20 AM UTC
We have mitigated the operational impact affecting ClickPipes in the us-east-1 region. Operational performance in this region has stabilized, and ingestion continues to function normally. We are continuing to monitor the system closely to ensure stability. Further updates will be provided if necessary.
- resolved Mar 03, 2026, 11:00 AM UTC
The operational impact affecting ClickPipes in the us-east-1 region has been fully resolved. All systems are operating normally, including ingestion and operational functionality. We will continue to monitor the platform to ensure ongoing stability. Thank you for your patience.
Minor March 1, 2026 Full outage on AWS me-central-1 region 81d 19h
Started Mar 01, 2026, 01:29 PM UTC· resolved May 22, 2026, 09:06 AM UTC
- investigating Mar 01, 2026, 01:29 PM UTC
There is a partial outage in AWS me-central-1 that is impacting our clusters in that region. As a result, services hosted in me-central-1 may be affected. We are actively investigating to assess the scope of the impact and implement mitigation measures where possible. For reference, please see the AWS Health Dashboard: https://health.aws.amazon.com/health/status
- investigating Mar 01, 2026, 03:36 PM UTC
We would like to provide an update regarding the ongoing partial outage in the me-central-1 region. The impact appears to be primarily concentrated in a single Availability Zone (AZ), although we have observed limited issues in other AZs. Approximately 33% of our instances in the region are currently unavailable, resulting in reduced capacity. Services remain operational but are running in a degraded state. Additionally, we are currently unable to create new instances or perform operations on existing clusters. We are actively monitoring the situation and evaluating mitigation options. Further updates will be shared as more information becomes available. For reference: https://health.aws.amazon.com/health/status
- investigating Mar 02, 2026, 11:12 AM UTC
We would like to provide a further update regarding the ongoing partial outage in the me-central-1 region. According to the latest information from AWS, an additional Availability Zone (AZ) is now impacted. The situation in the region has deteriorated, and the overall impact to services is significantly greater than previously reported. At this time, a high percentage of requests are failing, and customer-facing services in the region are experiencing severe degradation. Additionally, our monitoring systems in the region are also impacted, which is limiting real-time visibility into certain metrics and increasing operational complexity. Based on the most recent AWS updates, the estimated time to resolution remains many hours. We are actively tracking AWS communications and evaluating all available mitigation options to reduce customer impact wherever possible. We will provide further updates as soon as more information becomes available. For reference: https://health.aws.amazon.com/health/status
- investigating Mar 02, 2026, 02:31 PM UTC
We would like to provide an update regarding the ongoing incident in the me-central-1 region. The situation has further deteriorated and we are now experiencing a full outage in the region. Due to the loss of 2 out of 3 Availability Zones, the affected clusters have lost quorum. As a result, data ingestion is not possible at this time. Access to services in the region is now severely limited and operating in read-only mode where possible. We continue to closely monitor AWS updates. According to the latest communications from AWS, the estimated time to resolution is not at least a day. Our engineering teams are actively evaluating all available mitigation and recovery options. We will provide further updates as soon as more information becomes available. If you require further assistance or have urgent concerns, please contact our Support team through the usual support channels. For reference: https://health.aws.amazon.com/health/status
- investigating Mar 09, 2026, 11:34 PM UTC
AWS Middle East (UAE) Region (ME-CENTRAL-1) is still experiencing severe disruptions. We are actively monitoring the situation and following updates from AWS. Please follow the https://health.aws.amazon.com/health/status page for latest updates.
- resolved May 22, 2026, 09:06 AM UTC
ClickHouse Cloud no longer supports AWS me-central-1 "AWS me-central-1": https://health.aws.amazon.com/health/status?eventID=arn:aws:health:me-central-1::event/MULTIPLE_SERVICES/AWS_MULTIPLE_SERVICES_OPERATIONAL_ISSUE/AWS_MULTIPLE_SERVICES_OPERATIONAL_ISSUE_5E6B8_EF2498889B5. Customers who were running services in this region have been migrated to their region of choice, and the region is no longer available for selection. No further updates will be posted for this region.
Minor February 27, 2026 An issue with unidling ClickHouse instances in Azure regions 1h 42m germanywestcentral, eastus2, westus3
Started Feb 27, 2026, 08:07 AM UTC· resolved Feb 27, 2026, 09:49 AM UTC
- identified Feb 27, 2026, 08:07 AM UTC
We have spotted an issue where idled ClickHouse instances in Azure regions can't be woken up. Team is already working on a fix. We expect the fix to be rolled out soon.
- monitoring Feb 27, 2026, 09:26 AM UTC
A fix is deployed. Services waking up now (from idle or starting from stopped) will start as normal. Services that are currently stuck in waking will come up soon.
- monitoring Feb 27, 2026, 09:27 AM UTC
Azure region westus3 is fully operational again. All services previously stuck in waking up have started.
- monitoring Feb 27, 2026, 09:46 AM UTC
Azure eastus2 is fully operational again (all services stuck in waking started).
- resolved Feb 27, 2026, 09:49 AM UTC
All services stuck in waking in all azure regions are started now.
Minor February 21, 2026 Newly created instances in AWS us-east-1 are stuck provisioning or have wrong configuration 2h 36m us-east-1, us-east-1
Started Feb 21, 2026, 11:50 AM UTC· resolved Feb 21, 2026, 02:26 PM UTC
- investigating Feb 21, 2026, 11:50 AM UTC
We are investigating the issue where instances created in AWS us-east-1 have wrong configuration, causing provisioning to stuck or to have wrong number of replicas. This affects only a small number of instances created in last ~25 hours
- identified Feb 21, 2026, 12:01 PM UTC
We have identified the possible cause of the issue and applying remediation for stuck/misconfigured instances. We do not recommend creating new instances in us-east-1 until the incident is resolved.
- identified Feb 21, 2026, 12:29 PM UTC
We have fixed the root cause of the issue. Newly created instances have correct configuration now and are expected to provision successfully. Instances that currently are stuck or have wrong configuration are being corrected by the ClickHouse team. We are closely monitoring creation of new instances and remediation for existing stuck instances.
- monitoring Feb 21, 2026, 02:17 PM UTC
Configuration for all affected instances was corrected. We are monitoring the health status of these instances.
- resolved Feb 21, 2026, 02:26 PM UTC
All systems operational. We apologize for the disruption this issue caused. We are committed to the reliability of all ClickHouse Cloud services and appreciate your understanding as we continue to improve our systems and operations. If you have questions or need information on a specific ClickHouse service, please contact support "contact support": https://clickhouse.cloud/support.
Minor February 12, 2026 Partial outage in ClickPipes services (CDC ClickPipes) 1h 38m AWS ap-northeast-2, AWS us-east-2, AWS ap-southeast-2, AWS eu-central-1 and 2 more
Started Feb 12, 2026, 04:37 PM UTC· resolved Feb 12, 2026, 06:16 PM UTC
- investigating Feb 12, 2026, 04:37 PM UTC
There is an ongoing incident affecting CDC ClickPipes in us-east-1. The team is investigating.
- investigating Feb 12, 2026, 05:02 PM UTC
The incident is affecting all regions for CDC ClickPipes only. The team continues to investigate.
- identified Feb 12, 2026, 05:18 PM UTC
We have identified the issue and are working on a fix.
- identified Feb 12, 2026, 05:34 PM UTC
We are rolling out the fix region per region. ap-southeast-2 is now fully operational.
- identified Feb 12, 2026, 05:42 PM UTC
We have fixed the issue and rolled it out across all regions. In the next few minutes, you should see CDC ClickPipes recover and catch up on the replication backlog.
- monitoring Feb 12, 2026, 05:43 PM UTC
We continue monitoring the recovery of ClickPipes across all regions, after rolling out the fix to all affected CDC ClickPipes.
- resolved Feb 12, 2026, 06:16 PM UTC
After verifying that all affected ClickPipes have recovered, the incident can be declared as resolved. We will be sharing an RCA in the next few days with the affected customers. We sincerely apologize for the disruption caused.
Minor January 31, 2026 Elevated error rate in AWS 3d us-east-1, eu-west-2, ap-southeast-1, eu-central-1 and 1 more
Started Jan 31, 2026, 10:03 AM UTC· resolved Feb 03, 2026, 10:09 AM UTC
- investigating Jan 31, 2026, 10:03 AM UTC
We are investigating a partial outage affecting services in the AWS region us-east-1.
- identified Jan 31, 2026, 10:55 AM UTC
Our engineering team has identified the root cause of the service disruption affecting ClickHouse some instances in US-EAST-1. We are currently deploying a fix across the region. ClickHouse instances should begin resuming normal operations within the next 10-30 minutes. We will continue to monitor closely and provide updates as services are restored.
- resolved Jan 31, 2026, 11:51 AM UTC
This issue is now fixed.
- investigating Feb 01, 2026, 09:27 AM UTC
We are investigating an elevated error rate in AWS us-east-1 and eu-west-2.
- resolved Feb 01, 2026, 09:45 AM UTC
All components are operational after the restart of an internal component (Cilium) in the affected regions. The team is working on an RCA.
- investigating Feb 02, 2026, 09:35 AM UTC
We are investigating an elevated error rate in AWS eu-central-1 and ap-southeast-1.
- monitoring Feb 02, 2026, 10:23 AM UTC
The team mitigated the issue in affected regions and continues to investigate the root cause.
- monitoring Feb 02, 2026, 06:13 PM UTC
Additional configuration changes have been applied to prevent the recurrence of this issue. The team continues to monitor the systems.
- monitoring Feb 02, 2026, 10:47 PM UTC
We believe this is related to a known bug in the version of our networking stack currently in use and are mitigating the issue by resetting this layer across all AWS regions. The team continues to monitor all systems closely.
- monitoring Feb 03, 2026, 03:06 AM UTC
We have completed the reset of the networking stack across all regions and continue to monitor all systems closely.
- resolved Feb 03, 2026, 10:09 AM UTC
We have confirmed that all systems are stable and operating normally. The networking configuration has been fully restored across all regions, and we have implemented additional monitoring and safeguards to prevent recurrence. We will continue to monitor systems closely over the coming days as part of our standard post-incident procedures, and share an RCA as soon as possible.
Major January 31, 2026 Elevated error rate in AWS 1h 48m
Started Jan 31, 2026, 10:03 AM UTC· resolved Jan 31, 2026, 11:51 AM UTC
No vendor updates were posted for this incident.
Minor January 30, 2026 AWS ap-south-1 degraded operations 1h 32m ap-south-1
Started Jan 30, 2026, 11:55 AM UTC· resolved Jan 30, 2026, 01:27 PM UTC
- investigating Jan 30, 2026, 11:55 AM UTC
We are investigating issue in AWS ap-south-1 region where: - Admin operations on instances might be delayed or not progressing - Billing metrics not updated - Some dashboards in Control Plane UI not loading or loading slowly
- identified Jan 30, 2026, 12:08 PM UTC
The team has identified the issue and working on the fix. ClickHouse instances are expected to be reachable and working (except autoscaling functionality).
- monitoring Jan 30, 2026, 12:56 PM UTC
We are seeing signs of recovery, and closely monitoring.
- monitoring Jan 30, 2026, 01:16 PM UTC
User dashboards and autoscaling operations should be recovering now. Old data is already available, last hours are being backfilled.
- resolved Jan 30, 2026, 01:27 PM UTC
The issue is fully resolved. The latest data in ControlPlane UI monitoring dashboards was backfilled and should be available. The issue seems to be related to networking issues on underlying VMs. Team is investigating the root cause to make sure it won't happen again or in other regions.
Minor January 26, 2026 Issues with Cloud Console Authentication 11m
Started Jan 26, 2026, 05:17 PM UTC· resolved Jan 26, 2026, 05:28 PM UTC
No vendor updates were posted for this incident.
Minor January 23, 2026 Degraded performance of service level operations in Azure germanywestcentral region 13h 1m
Started Jan 23, 2026, 11:43 AM UTC· resolved Jan 24, 2026, 12:44 AM UTC
No vendor updates were posted for this incident.
Major December 15, 2025 Newly created ClickPipes for object-storage data not ingesting data 2h 55m
Started Dec 15, 2025, 06:20 PM UTC· resolved Dec 15, 2025, 09:16 PM UTC
No vendor updates were posted for this incident.
Major November 20, 2025 Investigating failed ClickPipes 56m
Started Nov 20, 2025, 02:29 PM UTC· resolved Nov 20, 2025, 03:25 PM UTC
No vendor updates were posted for this incident.
Minor November 14, 2025 Increased latency on the public API 1h 20m
Started Nov 14, 2025, 01:08 PM UTC· resolved Nov 14, 2025, 02:28 PM UTC
No vendor updates were posted for this incident.
Minor November 12, 2025 Increased latency and error rate for prometheus endpoint (ClickPipes only) 27m
Started Nov 12, 2025, 08:59 AM UTC· resolved Nov 12, 2025, 09:26 AM UTC
No vendor updates were posted for this incident.
Major November 7, 2025 Some object storage ClickPipes are failing 3h 3m
Started Nov 07, 2025, 10:59 PM UTC· resolved Nov 08, 2025, 02:02 AM UTC
No vendor updates were posted for this incident.