Cleeng Outage History

Started Oct 22, 2026, 11:14 AM UTC· resolved Oct 22, 2026, 11:14 AM UTC

1. resolved Oct 22, 2026, 11:14 AM UTC

   On October 20, 2026, details of two critical vulnerabilities in PHP, known as PHP2shell, were made public. These vulnerabilities could allow an attacker to run code remotely on affected systems. Further information is available in the PHP security announcement (https://www.php.net/archive/2026.php#2026-10-20-1) Our engineering team responded quickly and applied the patches to all our systems as soon as the patches were released. Our services kept running normally throughout, with no downtime or impact for our customers. We also reviewed our traffic for the whole of October 2026 and found no evidence of suspicious activity or misuse linked to these vulnerabilities. We’ll keep monitoring and will post here if anything changes. We recommend that you also check whether your own systems or third-party services use PHP, and apply the latest security updates from PHP and your software providers.

Read the full incident report →

Started Sep 30, 2026, 11:55 AM UTC· resolved Sep 30, 2026, 12:15 PM UTC

1. resolved Sep 30, 2026, 12:19 PM UTC

   Between 12:55 and 13:15 CET, a platform update caused a technical issue in our core services. During this time, some subscribers may have had trouble accessing their content or seen errors when logging in. Our team fixed the issue quickly, and everything has been running normally since 13:15 CET. We're reviewing our update process so this doesn't happen again and we apologize for any inconvenience.

Read the full incident report →

Started Sep 26, 2026, 12:49 AM UTC· resolved Sep 26, 2026, 08:55 AM UTC

1. identified Sep 26, 2026, 12:49 AM UTC

   A connection error between transctional database and reporting datalake in our data pipeline is preventing operational data from reaching our reporting environment. Affected: • Only reporting data is impacted. ChurnIQ dashboards are not refreshed since 00:30 CET • Scheduled 6-hourly data exports may be delayed Not affected: • Sign-up, checkout, payments, entitlements and the Core API are operating normally. Cleeng operational platform works normally. • All transactions continue to be recorded correctly in the platform Data is not being lost or corrupt. Once the connection is restored, the backlog will be processed and dashboards and exports will catch up automatically. Support team of the vendor that supports the pipeline engineering team is working to restore the connection.

2. resolved Sep 26, 2026, 08:55 AM UTC

   The connection between the two data sources was resolved around 4:50 in the morning. Everything is working as expected now.

Read the full incident report →

Started Sep 08, 2026, 02:13 PM UTC· resolved Sep 08, 2026, 03:24 PM UTC

1. identified Sep 08, 2026, 02:13 PM UTC

   We are currently experiencing an issue accessing the Cleeng Dashboard in the Sandbox environment. No action is required on your end. We apologize for any inconvenience this may have caused.

2. resolved Sep 08, 2026, 03:24 PM UTC

   The issue has now been resolved, and the Cleeng Dashboard in Sandbox is accessible again. Thank you for your patience and understanding.

Read the full incident report →

Started Sep 03, 2026, 11:30 PM UTC· resolved Sep 04, 2026, 12:05 AM UTC

1. resolved Sep 04, 2026, 09:22 AM UTC

   An infrastructure degradation affected the Core APIs between 01:32 and 02:05 CEST. Publishers and their customers may have experienced increased response times or rejected API requests during this period. All other Cleeng services were unaffected. The Core APIs are fully operational currently.

Read the full incident report →

Started Aug 20, 2026, 07:05 AM UTC· resolved Aug 20, 2026, 07:30 AM UTC

1. resolved Aug 20, 2026, 08:59 PM UTC

   August 20, 2026 at 08:05–08:30 CET The service platform experienced a period of degradation during this time. The issue has been resolved, and the platform is now fully operational and functioning as expected.

Read the full incident report →

Started Aug 11, 2026, 08:42 AM UTC· resolved Aug 11, 2026, 09:26 AM UTC

1. monitoring Aug 11, 2026, 08:42 AM UTC

   Cleeng reporting data has not refreshed since 07:00 CET today (2026-08-11). This happened because our job runners did not run the scheduled data pipeline. We are aware of the situation, a fix has been put in place, and the data pipelines are working now. We expect the data to start refreshing within 30 minutes. Please note that no data has been lost as a result of this incident, and it has no consequence on our platform operations.

2. resolved Aug 11, 2026, 09:26 AM UTC

   The reporting data is fully refreshed. All data pipelines are working as expected.

Read the full incident report →

Started Jul 28, 2026, 11:35 AM UTC· resolved Jul 29, 2026, 06:39 AM UTC

1. identified Jul 28, 2026, 11:35 AM UTC

   Starting at 9:10 CET, we identified an issue affecting the checkout experience, where some customers were unable to load the checkout page or complete their purchases. The issue was caused by outdated cached credentials within one of our services. A temporary fix has been implemented, and the issue has not reoccurred since. We continue to monitor the platform closely while our engineering team works on a permanent solution, which is expected to be deployed by Monday at the latest. We apologize for any inconvenience caused and appreciate your patience.

2. resolved Jul 29, 2026, 06:39 AM UTC

   The Cleeng Checkout and Widgets are fully operational in production. The issue has been resolved, and payment processing is functioning normally. No further occurrences have been observed since the fix was implemented.

Read the full incident report →

Started Jul 16, 2026, 09:24 AM UTC· resolved Jul 16, 2026, 10:36 AM UTC

1. investigating Jul 16, 2026, 09:24 AM UTC

   We’re investigating an incident affecting Cleeng Widgets across all environments. Users may encounter 504 Gateway Timeout errors when loading checkout and other widget pages. Our engineering team is working to restore service. We’ll provide further updates as soon as more information is available.

2. identified Jul 16, 2026, 09:48 AM UTC

   We’ve isolated the incident to an AWS CloudFront issue affecting traffic to Cleeng Widgets across all environments. Our engineering team is monitoring the disruption and evaluating recovery options.

3. monitoring Jul 16, 2026, 10:07 AM UTC

   The incident has been traced to an ongoing AWS CloudFront service disruption, which is preventing traffic from reaching Cleeng Hosted Widgets. AWS is working to restore the service; updates are available on the AWS Health Dashboard: https://health.aws.amazon.com/health/status Hosted Widget clients remain impacted. We're monitoring AWS recovery and assessing alternative solutions.

4. resolved Jul 16, 2026, 10:36 AM UTC

   The AWS CloudFront issue has been resolved, and Cleeng Hosted Widgets are fully operational in production. Registrations, account creation, and payment processing have been restored.

Read the full incident report →

Started Jun 24, 2026, 02:50 PM UTC· resolved Jun 24, 2026, 07:11 PM UTC

1. identified Jun 24, 2026, 02:50 PM UTC

   We are currently aware of an ongoing issue reported by our email provider, Mailchimp, which may cause delays in the delivery of 2FA emails. Mailchimp posted an incident on 24 June 2026 at 13:26 UTC, stating that they are investigating connectivity issues and email sending delays. As a result, customers using 2FA may experience delays in receiving their authentication codes when attempting to log in. Mailchimp's engineering team is actively investigating the issue and working toward a resolution. We are closely monitoring the situation and will provide updates as soon as more information becomes available. We apologize for the inconvenience and appreciate your patience.

2. monitoring Jun 24, 2026, 03:47 PM UTC

   Update – Improvements Observed in 2FA Email Delivery Delays We are seeing improvements regarding the issue affecting 2FA email delivery. Our email provider, Mandrill, posted an update on today (24 June 2026 at 15:26 UTC), indicating that connectivity issues and email sending delays are improving, while their engineering team continues to work on a permanent fix. Customers using 2FA may still experience intermittent delays in receiving their authentication codes when attempting to log in, though service performance is improving. We will continue to monitor the situation closely and provide further updates as more information becomes available. Thank you for your patience and understanding.

3. resolved Jun 24, 2026, 07:11 PM UTC

   The issue affecting 2FA email delivery has been resolved. Mandrill marked the incident as resolved today at 18:48 UTC, confirming that the connectivity issues and email sending delays have been addressed. Customers should now be able to receive their 2FA emails as expected when attempting to log in. We will continue to monitor the service to ensure stability. We apologize for any inconvenience caused and thank you for your patience throughout this incident.

Read the full incident report →

Started Jun 23, 2026, 03:53 PM UTC· resolved Jun 23, 2026, 06:59 PM UTC

1. identified Jun 23, 2026, 03:53 PM UTC

   Login using 2FA may fail intermittently due to delayed or missing authentication emails sent via Mandrill. Users may be unable to complete the login process when a 2FA is required. This issue is caused by an ongoing incident with our email service provider (Mandrill), which is affecting email delivery performance. We are actively monitoring the situation and coordinating with them to resolve it as quickly as possible.

2. resolved Jun 23, 2026, 06:59 PM UTC

   Mandrill confirmed that the issue regarding delayed emails is now resolved. As a result, login flows requiring 2FA emails should now function as expected.

Read the full incident report →

Started Jun 23, 2026, 10:57 AM UTC· resolved Jun 23, 2026, 11:34 AM UTC

1. resolved Jun 23, 2026, 10:57 AM UTC

   Between 12:11 CET and 12:24 CET, Cleeng experienced a platform service disruption that may have impacted access to certain services. The issue has now been resolved, and services have been restored. We are continuing to closely monitor the platform to ensure ongoing stability. While service has been restored, our engineering team is still actively investigating the incident to determine the root cause and prevent similar occurrences in the future. We apologize for the disruption and thank you for your patience.

Read the full incident report →

Started Apr 03, 2026, 10:03 PM UTC· resolved Apr 03, 2026, 10:31 PM UTC

1. identified Apr 03, 2026, 10:03 PM UTC

   We are currently experiencing increased error rates affecting some endpoints. Our monitoring systems have detected higher-than-normal failed requests, and our engineering team is actively working on a resolution. Impact: Certain integrations and API requests may fail or respond slowly. Some customers may experience errors when accessing specific services.

2. resolved Apr 03, 2026, 10:31 PM UTC

   The disruption affecting the endpoints has been resolved. All systems are now operating normally, and API requests and integrations are functioning as expected. We apologize for any inconvenience caused and thank you for your patience.

Read the full incident report →

Started Apr 01, 2026, 11:27 AM UTC· resolved Apr 01, 2026, 02:32 PM UTC

1. investigating Apr 01, 2026, 11:27 AM UTC

   We have identified an issue affecting exportable tables in the dashboard. Some users may experience difficulty accessing the exportable tables in the publisher dashboard, however, the scheduled exports are not affected and are still being delivered as expected. Our team is actively investigating and working to restore full functionality. We apologize for any inconvenience this may have caused.

2. monitoring Apr 01, 2026, 02:12 PM UTC

   A fix has been implemented and is ready for release.

3. resolved Apr 01, 2026, 02:32 PM UTC

   The fix is deployed, exportable reports should now work as expected.

Read the full incident report →

Started Mar 27, 2026, 12:22 PM UTC· resolved Mar 28, 2026, 12:05 PM UTC

1. resolved Mar 27, 2026, 12:31 PM UTC

   We recently identified an issue affecting subscription counts in your reports, which began on 26 March 2026 at 13:22 CET and was fully resolved on 27 March 2026 at 13:05 CET. During this window, subscription totals were understated in the dashboard and subscription report. All data has since been corrected and is now accurate. No action is required on your end. We apologize for any inconvenience this may have caused.

Read the full incident report →

Started Mar 06, 2026, 01:25 PM UTC· resolved Mar 06, 2026, 04:45 PM UTC

1. investigating Mar 06, 2026, 01:25 PM UTC

   Please be aware that due to a partial outage affecting a third-party data processing service, Cleeng reporting data refresh is currently delayed. We have been observing the delay since approximately 19:00 CET yesterday (5 March) and are coordinating with the vendor while they restore full service. Impact: ChurnIQ dashboards and exported data reports may not yet reflect the most recent activity. Data may appear delayed by several hours. Who is impacted: Clients using ChurnIQ dashboards or receiving exported reporting files may see data that is not fully up to date. Please note that Cleeng platform operations are not affected. All standard platform functionality and client transactions continue to operate normally.

2. investigating Mar 06, 2026, 01:36 PM UTC

   We are continuing to investigate this issue.

3. identified Mar 06, 2026, 03:05 PM UTC

   Our vendor has identified the cause and is working on a fix.

4. monitoring Mar 06, 2026, 04:30 PM UTC

   Fix has been implemented and the data is now refreshed. We are monitoring the pipelines now.

5. resolved Mar 06, 2026, 04:45 PM UTC

   Data pipelines operating normally

Read the full incident report →

Started Dec 16, 2025, 08:49 AM UTC· resolved Dec 16, 2025, 05:03 PM UTC

1. identified Dec 16, 2025, 08:49 AM UTC

   We are currently experiencing an external outage with Snowflake. Due to this, you may experience delayed visibility for the most recent data. The last successful data refresh occurred at 12:01 AM CET on December 16, 2025. As of 05:04 UTC, Snowflake has developed a fix and is preparing it for deployment. Snowflake estimates that the service will be restored within the next 5 hours.

2. identified Dec 16, 2025, 12:44 PM UTC

   Snowflake has provided an updated timeline, with service estimated to be restored by 3:00 PM UTC. We will continue to monitor and share further updates.

3. resolved Dec 16, 2025, 05:03 PM UTC

   This incident has been resolved.

Read the full incident report →

Started Nov 18, 2025, 12:28 PM UTC· resolved Nov 18, 2025, 06:57 PM UTC

1. monitoring Nov 18, 2025, 12:28 PM UTC

   CloudFlare is experiencing a global outage, causing unavailability of our marketing pages (cleeng.com). This is NOT affecting Cleeng APIs, but you may be impacted by outages of our third party services (e.g. Adyen, https://status.adyen.com/).

2. resolved Nov 18, 2025, 06:57 PM UTC

   This incident has been resolved.

Read the full incident report →

Started Nov 13, 2025, 11:10 AM UTC· resolved Nov 13, 2025, 12:10 PM UTC

1. resolved Nov 13, 2025, 12:29 PM UTC

   Cleeng Sandbox environment was not available for almost 1 hour from 12:10 to 13:10 CET on 13th November 2025. The issue is fixed, and it is available for use now.

Read the full incident report →

Started Jul 07, 2025, 11:26 AM UTC· resolved Jul 07, 2025, 01:10 PM UTC

1. resolved Jul 09, 2025, 12:33 PM UTC

   We experienced a service outage affecting MediaStore Widgets from yesterday, 12:26 CET until today, 14:10 CET. Root Cause: Human error during deployment - an external dependency was installed without sufficient testing, causing the widget service to fail. Impact: embedding of MediaStore Widgets was not working during this period. Resolution: The problematic dependency was rolled back and service was fully restored at 14:10. We apologize for the inconvenience and have implemented additional testing protocols to prevent similar issues in the future.

Read the full incident report →

Started May 05, 2025, 11:32 AM UTC· resolved May 05, 2025, 12:05 PM UTC

1. resolved May 05, 2025, 01:13 PM UTC

   Between 13:32 and 14:05 CEST, we observed a temporary issue with the Configuration Service database, which may have affected certain integrations (Adyen, SK2, Samsung, Vizio, ReCaptcha). Most live traffic continued to receive configuration data from our fast-access memory layer, which temporarily stores recent settings as additional safeguard. Additionally, configuration changes made between 07:00 and 14:05 CEST were not saved and have been lost. A detailed timeline and impact assessment is in progress. RCA will be shared once available.

2. postmortem May 09, 2025, 11:46 AM UTC

   Dear Broadcasters, We've concluded our investigation into the recent incident regarding configuration sync delay. For a more comprehensive postmortem, please feel free to review the document attached below, which contains the full Root Cause Analysis \(RCA\). Thank you for your patience and continued support. [RCA\_2025Q2 - Configuration per Broadcaster Service Incident.pdf](https://drive.google.com/file/d/1e_uNO04PG7L7RYcgKK3qHgUj0sq9_lK2/view?usp=sharing)

Read the full incident report →

Started Jan 08, 2025, 10:26 PM UTC· resolved Jan 09, 2025, 08:08 AM UTC

1. investigating Jan 08, 2025, 10:26 PM UTC

   For some unknown reason, workflow for 15 minutes data refresh is not running automatically since ~19:00 CET. Consequently, data is not be refreshed every 15 minutes, we will trigger a few manual runs to keep the data refreshed. As we see now, all other data refresh pipelines are running normally. We are currently working to find the solution.

2. resolved Jan 09, 2025, 08:08 AM UTC

   This incident has been resolved.

Read the full incident report →

Started Dec 18, 2024, 08:29 AM UTC· resolved Jan 17, 2025, 09:28 AM UTC

1. monitoring Dec 18, 2024, 08:29 AM UTC

   Some drill-fields are temporarily unavailable. We are working to restore the full functionality as soon as possible.

2. monitoring Dec 18, 2024, 08:51 AM UTC

   We are continuing to monitor for any further issues.

3. resolved Jan 17, 2025, 09:28 AM UTC

   This incident has been resolved.

Read the full incident report →

Started Nov 05, 2024, 03:58 AM UTC· resolved Nov 05, 2024, 05:10 AM UTC

1. investigating Nov 05, 2024, 03:58 AM UTC

   We are experiencing significant delays for transactional emails to customers. The team is working on resolving this issue.

2. identified Nov 05, 2024, 04:27 AM UTC

   The issue is now under control - emails are sent out with minimal delay (seconds) now. The team is working on a permanent fix.

3. resolved Nov 05, 2024, 05:10 AM UTC

   The issue has been resolved.

4. postmortem Nov 07, 2024, 06:33 PM UTC

   Dear Broadcasters, We've concluded our investigation into the recent incident regarding the delayed customer email delivery. For a more comprehensive postmortem, please feel free to review the document attached below, which contains the full Root Cause Analysis \(RCA\). Thank you for your patience and continued support. [RCA-2024Q4-Delayed customer email delivery.pdf](https://drive.google.com/file/d/1J6-EhjlowfSVR2I-n-LDosw02ArIx0s0/view?usp=drive_link)

Read the full incident report →