- Detected by Pingoru
- Jan 19, 2026, 12:05 AM UTC
- Resolved
- Jan 19, 2026, 08:35 AM UTC
- Duration
- 8h 29m
Affected: Piano Content Crawler Data Collection
Timeline · 7 updates
-
investigating Jan 19, 2026, 12:05 AM UTC
Piano Crawler has not been crawling for the last 24 hours. We are currently investigating the issue.
-
investigating Jan 19, 2026, 02:23 AM UTC
We are continuing to investigate this issue.
-
investigating Jan 19, 2026, 03:55 AM UTC
We are still looking into this issue, but the investigation shows that this affects only a small number of sites, not all of them.
-
identified Jan 19, 2026, 06:54 AM UTC
The issue has been identified and a fix is being implemented.
-
monitoring Jan 19, 2026, 07:22 AM UTC
A fix has been implemented and we are monitoring the results.
-
resolved Jan 19, 2026, 08:35 AM UTC
This incident has been resolved.
-
postmortem Jan 28, 2026, 08:50 AM UTC
RCA report for the incident can be found at [this link](https://docs.piano.io/wp-content/uploads/2026/01/2026-01-19-RCA-Piano-Crawler-not-crawling.pdf)
Read the full incident report →
- Detected by Pingoru
- Jan 12, 2026, 12:07 PM UTC
- Resolved
- Jan 13, 2026, 01:11 AM UTC
- Duration
- 13h 4m
Affected: Other
Timeline · 4 updates
-
investigating Jan 12, 2026, 12:07 PM UTC
Composer is experiencing a service incident affecting DMP segments and Propensity Models in the EU region. Impact includes high error rates, degraded segment lookup, and degraded widget performance.
-
identified Jan 12, 2026, 02:19 PM UTC
The issue has been identified and a fix is being implemented.
-
monitoring Jan 12, 2026, 02:55 PM UTC
A fix has been implemented and we are monitoring the results.
-
resolved Jan 13, 2026, 01:11 AM UTC
This incident has been resolved.
Read the full incident report →
Critical December 24, 2025 - Detected by Pingoru
- Dec 24, 2025, 02:21 PM UTC
- Resolved
- Dec 24, 2025, 09:44 PM UTC
- Duration
- 7h 22m
Affected: Publisher Dashboard - US - https://dashboard.piano.ioVX Checkout - US - buy.piano.ioAPI Endpoints - US - api.piano.ioComposer Experience Execution - US
Timeline · 5 updates
-
investigating Dec 24, 2025, 02:21 PM UTC
Piano platform is experiencing an elevated level of API errors. Our engineers are currently looking into the issue.
-
identified Dec 24, 2025, 02:43 PM UTC
The issue has been identified and a fix is being implemented.
-
monitoring Dec 24, 2025, 02:53 PM UTC
A fix has been implemented, and we're monitoring its results
-
resolved Dec 24, 2025, 09:44 PM UTC
The incident has been resolved.
-
postmortem Jan 07, 2026, 08:43 AM UTC
RCA report for the incident can be found at [**this link**](https://docs.piano.io/wp-content/uploads/2026/01/2025-12-24-RCA-Activation-outage.pdf).
Read the full incident report →
- Detected by Pingoru
- Dec 16, 2025, 03:30 AM UTC
- Resolved
- Dec 16, 2025, 09:30 PM UTC
- Duration
- 17h 59m
Affected: Piano Analytics Data Processing
Timeline · 5 updates
-
investigating Dec 16, 2025, 06:35 AM UTC
We are currently experiencing a production incident on Piano Analytics products. A major incident is currently ongoing with our cloud provider in the EU regions, impacting both streaming data ingestion and data consolidation processes. Our data collection and processing are not impacted. The issue started at approximately 03:30 UTC on December 16, 2025, and is still ongoing at this time on their side. Please excuse us for any inconvenience caused.
-
investigating Dec 16, 2025, 08:54 AM UTC
We are continuing to investigate this issue.
-
identified Dec 16, 2025, 10:40 AM UTC
Our provider's service has been partially restored. Our teams are now actively working on completing the recovery on our side, including relaunching data loads and catching up on delayed processing.
-
resolved Dec 17, 2025, 09:23 AM UTC
The issue has been resolved and all (Piano Analytics) tools and interfaces are fully available. Some data still needs to be sent for some specific customers, but we will communicate with them directly.
-
postmortem Dec 17, 2025, 09:23 AM UTC
**Incident explanation:** A major incident has occurred with our cloud provider in the EU regions, impacting both streaming data ingestion and data consolidation processes. Our data collection and processing were not impacted. **Actions performed:** Once the provider service was restored, we checked the status of our system and restarted whatever needed to be restarted. Everything gradually returned to normal. **Actions to come:** We still need to address a few data transfer issues for specific customers on a case-by-case basis (particularly dataflow exports).Everything should be back to normal by this morning.
Read the full incident report →
Critical December 5, 2025 - Detected by Pingoru
- Dec 05, 2025, 08:47 AM UTC
- Resolved
- Dec 05, 2025, 09:30 AM UTC
- Duration
- 42m
Affected: Publisher Dashboard - US - https://dashboard.piano.ioAPI Endpoints - US - api.piano.ioPublisher Dashboard - Asia - https://dashboard-ap.piano.ioAPI Endpoints - Asia - api-ap.piano.ioPublisher Dashboard - Australia - https://dashboard-au.piano.ioAPI Endpoints - AU - api-au.piano.ioPublisher Dashboard - Europe - https://dashboard-eu.piano.ioAPI Endpoints - EU - api-eu.piano.io
Timeline · 4 updates
-
identified Dec 05, 2025, 09:02 AM UTC
We are currently experiencing a service disruption affecting our services due to an outage on Cloudflare's side. As a result, clients may also experience difficulties logging into Piano dashboards. Our team is actively monitoring the situation. We apologize for any inconvenience this may cause and appreciate your patience. Further updates will be provided as soon as more information becomes available. For reference: https://www.cloudflarestatus.com/
-
identified Dec 05, 2025, 09:10 AM UTC
We are currently experiencing a service disruption affecting our services due to an outage on Cloudflare's side. For reference: https://www.cloudflarestatus.com/incidents/lfrm31y6sw9q
-
monitoring Dec 05, 2025, 09:17 AM UTC
Cloudflare has fixed the issue on their end (https://www.cloudflarestatus.com/incidents/lfrm31y6sw9q), and we are now observing incoming requests on our systems again. We will continue to monitor the situation and provide updates if anything changes.
-
resolved Dec 05, 2025, 09:30 AM UTC
This incident has been resolved.
Read the full incident report →
- Detected by Pingoru
- Dec 03, 2025, 08:15 PM UTC
- Resolved
- Dec 04, 2025, 03:46 PM UTC
- Duration
- 19h 31m
Affected: API Endpoints - cxense - api.cxense.com
Timeline · 5 updates
-
identified Dec 03, 2025, 08:15 PM UTC
We have identified an issue affecting the ingestion of user profile updates, causing processing delays. Our engineering team has implemented remediation measures, and we are currently working to process the backlog of delayed updates.
-
identified Dec 03, 2025, 09:14 PM UTC
Backlog of delayed updates have been processed. We continue to monitor the situation.
-
monitoring Dec 03, 2025, 09:39 PM UTC
We continue to monitor the situation.
-
resolved Dec 04, 2025, 03:46 PM UTC
This incident has been resolved.
-
postmortem Dec 17, 2025, 08:52 AM UTC
RCA report for the incident can be found at [**this link**](https://docs.piano.io/wp-content/uploads/2025/12/2025-12-03-RCA-Delays-in-ingestion-of-user-profile-updates.pdf).
Read the full incident report →
- Detected by Pingoru
- Dec 02, 2025, 09:02 AM UTC
- Resolved
- Dec 02, 2025, 08:01 PM UTC
- Duration
- 10h 58m
Affected: Piano Content Crawler Data Collection
Timeline · 4 updates
-
identified Dec 02, 2025, 09:02 AM UTC
We are currently experiencing an incident where newly published articles are not crawled immediately due to an accumulated event lag. Our engineers identified the issue and promptly applied a fix. The system is clearing the processing backlog, and normal crawling should resume within a few hours.
-
monitoring Dec 02, 2025, 01:02 PM UTC
Crawler processing is now functioning normally. However, we are still observing an approximate 4-hour delay. We are closely monitoring the situation and will update once the lag has been fully resolved.
-
resolved Dec 02, 2025, 08:01 PM UTC
The issue has been resolved, and crawling services are operating normally.
-
postmortem Dec 09, 2025, 07:27 AM UTC
RCA report for the incident can be found at [**this link**](https://docs.piano.io/wp-content/uploads/2025/12/2025-12-02-RCA-Piano-Content_-Crawling-delay.pdf).
Read the full incident report →
Critical November 28, 2025 - Detected by Pingoru
- Nov 28, 2025, 01:54 AM UTC
- Resolved
- Nov 28, 2025, 04:45 AM UTC
- Duration
- 2h 50m
Affected: Piano Insight Dashboard
Timeline · 3 updates
-
investigating Nov 28, 2025, 03:26 AM UTC
We noticed a significant traffic drop in Insight started on November 28, 2025 01:54 UTC. Our engineers are investigating the issue.
-
monitoring Nov 28, 2025, 03:54 AM UTC
Our engineers have identified the root cause and have implemented the fix. We are monitoring the results.
-
resolved Nov 28, 2025, 04:45 AM UTC
This incident has been resolved.
Read the full incident report →
- Detected by Pingoru
- Nov 22, 2025, 05:12 AM UTC
- Resolved
- Nov 24, 2025, 08:25 AM UTC
- Duration
- 2d 3h
Affected: API Endpoints - cxense - api.cxense.comPiano Insight Dashboard
Timeline · 3 updates
-
identified Nov 22, 2025, 05:12 AM UTC
We noticed a significant traffic drop in Insight started on November 22, 2025 02:37 UTC. The technical team identified the root cause and is now working on the resolution.
-
monitoring Nov 22, 2025, 05:47 AM UTC
Monitoring - The issue has been resolved, and services are operating normally. We are continuing to monitor the situation to ensure ongoing stability.
-
resolved Nov 24, 2025, 08:25 AM UTC
This incident has been resolved.
Read the full incident report →
- Detected by Pingoru
- Oct 29, 2025, 07:27 AM UTC
- Resolved
- Oct 29, 2025, 07:27 AM UTC
- Duration
- —
Affected: Composer Experience Execution - USComposer Experience Execution - Europe
Timeline · 1 update
-
resolved Oct 29, 2025, 07:27 AM UTC
Piano detected elevated 400 errors on API Interaction for Server Composer Experiences between 6:22 AM - 6:43 AM UTC in the US and EU regions. This was caused by a new release that introduced a serialization logic change, resulting in unexpected object graph handling. The issue was auto-detected and immediately resolved via our monitoring system. We apologize for any inconvenience caused and will enhance automated smoke testing for server-side experiences to prevent similar issues.
Read the full incident report →
Critical October 24, 2025 - Detected by Pingoru
- Oct 24, 2025, 08:22 AM UTC
- Resolved
- Oct 24, 2025, 08:44 AM UTC
- Duration
- 22m
Affected: Piano Analytics - Reporting APIPiano Analytics Interfaces Availability
Timeline · 3 updates
-
investigating Oct 24, 2025, 08:22 AM UTC
We are currently experiencing availability issues with our API tools and interfaces. Our technical teams are actively working to resolve the issue. We apologize for any inconvenience caused. Affected customers - All customers
-
resolved Oct 24, 2025, 08:44 AM UTC
The issue has been resolved and all our tools and interfaces are fully available. Data collection was not affected, all events were properly ingested.
-
postmortem Oct 24, 2025, 08:44 AM UTC
**Incident explanation:** A production release caused temporary inaccessibility of our interfaces. **Actions performed:** A rollback was performed to restore service. **Actions to come:** No more actions to come.
Read the full incident report →
- Detected by Pingoru
- Oct 20, 2025, 08:09 AM UTC
- Resolved
- Oct 20, 2025, 01:52 PM UTC
- Duration
- 5h 42m
Affected: VX Checkout - US - buy.piano.ioAPI Endpoints - US - api.piano.ioComposer Experience Execution - USUS - id.piano.ioPiano ID and VX transactional EmailsAPI Endpoints - EU - api-eu.piano.io
Timeline · 9 updates
Read the full incident report →
- Detected by Pingoru
- Oct 16, 2025, 02:21 AM UTC
- Resolved
- Oct 16, 2025, 07:09 AM UTC
- Duration
- 4h 48m
Affected: Other
Timeline · 3 updates
-
investigating Oct 16, 2025, 02:21 AM UTC
Sandbox.piano.io is currently unavailable. We apologize for any inconvenience caused.
-
monitoring Oct 16, 2025, 07:01 AM UTC
A fix has been implemented and we are monitoring the results.
-
resolved Oct 16, 2025, 07:09 AM UTC
This incident has been resolved.
Read the full incident report →
- Detected by Pingoru
- Oct 07, 2025, 01:41 PM UTC
- Resolved
- Oct 07, 2025, 02:45 PM UTC
- Duration
- 1h 4m
Affected: Piano Analytics Interfaces Availability
Timeline · 3 updates
-
investigating Oct 07, 2025, 01:41 PM UTC
We are currently experiencing availability issues with some properties in our Piano Analytics tools. Our technical teams are actively working to resolve the issue. We apologize for any inconvenience caused. Affected customers - All customers
-
resolved Oct 07, 2025, 02:45 PM UTC
The issue has been resolved and all our properties and tools are fully available.
-
postmortem Oct 07, 2025, 02:45 PM UTC
**Incident explanation:** There has been a synchronization issue between the Data Model and the interfaces, which prevented some properties to be shown in the analyses. **Actions performed:** All the properties were correctly resynchronized. **Actions to come:** Measures will be taken to ensure that these property synchronization issues do not occur again in the long term.
Read the full incident report →
- Detected by Pingoru
- Oct 06, 2025, 03:12 PM UTC
- Resolved
- Oct 06, 2025, 05:04 PM UTC
- Duration
- 1h 51m
Affected: Piano Analytics - Reporting APIPiano Analytics Interfaces Availability
Timeline · 3 updates
-
investigating Oct 06, 2025, 03:12 PM UTC
We are currently experiencing an issue on Data Query 3 (Piano Analytics) when applying a filter on specific properties. Our technical teams are actively working to resolve the issue. We apologize for any inconvenience caused. Affected customers - All customers
-
resolved Oct 06, 2025, 05:04 PM UTC
The issue has been resolved and all our tools and interfaces are fully available.
-
postmortem Oct 06, 2025, 05:04 PM UTC
**Incident explanation:** Synchronization problem on properties format type mapping **Actions performed:** Restoring the right format types for the affected properties **Actions to come:** No more action to come
Read the full incident report →
Notice September 29, 2025 - Detected by Pingoru
- Sep 29, 2025, 11:36 AM UTC
- Resolved
- Sep 29, 2025, 11:36 AM UTC
- Duration
- —
Affected: API Endpoints - US - api.piano.io
Timeline · 1 update
-
resolved Sep 29, 2025, 11:36 AM UTC
Piano experienced elevated error rates on VX endpoints in the US region. The issue started at 7:39 AM and was fully resolved by 7:45 AM UTC. All affected endpoints are operating normally and error rates have returned to baseline levels.
Read the full incident report →
- Detected by Pingoru
- Sep 19, 2025, 04:37 PM UTC
- Resolved
- Sep 22, 2025, 09:01 AM UTC
- Duration
- 2d 16h
Affected: Composer Experience Execution - US
Timeline · 3 updates
-
identified Sep 19, 2025, 04:37 PM UTC
Our devs have identified an issue with the user access check not being recognized on an intermittent basis. We will share an update as soon as there is progress.
-
monitoring Sep 19, 2025, 05:03 PM UTC
The partial access check was identified to be occurring about 30 % the time for a brief period between 23:30 UTC (Sep 18) - 3:30 UTC (Sep 19). Additional logging and resilience features are being worked on by our developers to avoid recurrence. We will continue to monitor the progress
-
resolved Sep 22, 2025, 09:01 AM UTC
This incident has been resolved.
Read the full incident report →
- Detected by Pingoru
- Sep 11, 2025, 08:06 AM UTC
- Resolved
- Sep 11, 2025, 08:47 AM UTC
- Duration
- 41m
Affected: Piano Analytics Data ProcessingPiano Analytics Dataflow Exports
Timeline · 3 updates
-
investigating Sep 11, 2025, 08:06 AM UTC
We are currently experiencing a delay in real-time data processing on Piano Analytics. Scheduled exports will be sent once the data is ready. Our technical teams are actively working to resolve the issue. We apologize for any inconvenience caused. Affected customers - Less than 1%
-
resolved Sep 11, 2025, 08:47 AM UTC
The issue has been resolved and all scheduled exports have been sent.
-
postmortem Sep 11, 2025, 08:47 AM UTC
**Incident explanation:** One of our data processing providers experienced an issue with a pipeline, which caused our files to be blocked and delayed. **Actions performed:** We implemented an alternate loading method for new incoming data to restore real-time processing. Our provider has resolved the pipeline issue. **Actions to come:** No more actions to come.
Read the full incident report →
- Detected by Pingoru
- Aug 28, 2025, 06:51 PM UTC
- Resolved
- Aug 28, 2025, 10:10 PM UTC
- Duration
- 3h 18m
Affected: Other
Timeline · 5 updates
-
investigating Aug 28, 2025, 06:51 PM UTC
Our developers are currently investigating the issue of the template previews not loading in the sandbox. We will share an update as soon as there is progress.
-
investigating Aug 28, 2025, 07:33 PM UTC
We are continuing to investigate this issue.
-
identified Aug 28, 2025, 07:34 PM UTC
Our developers have identified the issue and actively working on a fix. We will update the status once the fix is released.
-
monitoring Aug 28, 2025, 08:05 PM UTC
Our devs have released the fix. Based on our internal testing, the preview functionality is back on Sandbox. We will continue to monitor
-
resolved Aug 28, 2025, 10:10 PM UTC
This incident has been resolved.
Read the full incident report →
- Detected by Pingoru
- Aug 14, 2025, 09:00 AM UTC
- Resolved
- Aug 14, 2025, 03:49 PM UTC
- Duration
- 6h 48m
Affected: SocialFlow publishing
Timeline · 3 updates
-
investigating Aug 14, 2025, 01:04 PM UTC
We are currently experiencing partial issues with Facebook publishing. Some clients are encountering an error that prompts them to reauthenticate. Our team is actively investigating the issue.
-
resolved Aug 14, 2025, 03:49 PM UTC
We have resolved an issue where Facebook expired several sessions, causing disruptions for some users. Affected handles were manually invalidated by our team, and users were requested to reauthenticate. Following successful reauthentication, normal functionality has been restored.
-
postmortem Aug 18, 2025, 02:01 PM UTC
**Client Impact:** On August 14, 2025, some customers experienced issues publishing content on Facebook. Affected users received an error message prompting them to reauthenticate their accounts. **Incident Timeline:** * **Start:** 14-08-2025, 09:00 AM UTC * **End:** 14-08-2025, 04:00 PM UTC **Root Cause:** Upon investigation, we discovered that the problem originated from Facebook. A significant number of user tokens expired, necessitating reauthentication of users’ accounts. **Preventative Measures:** 1. We will enhance our monitoring systems to reduce false positives, enabling quicker identification of similar issues in the future. 2. We plan to automate the invalidation of user sessions upon receiving such errors from Facebook. This will prompt users to reauthenticate seamlessly.
Read the full incident report →
- Detected by Pingoru
- Jul 17, 2025, 01:42 PM UTC
- Resolved
- Jul 17, 2025, 02:29 PM UTC
- Duration
- 47m
Affected: Piano Analytics ExportsPiano Analytics Dataflow Exports
Timeline · 3 updates
-
investigating Jul 17, 2025, 01:42 PM UTC
We are currently experiencing delays in the generation of some scheduled exports. Our technical teams are working to resolve this issue so that these exports may be sent as soon as possible. We apologise for any inconvenience caused. Affected customers - All customers
-
resolved Jul 17, 2025, 02:29 PM UTC
The issue has been resolved and all exports have been sent.
-
postmortem Jul 17, 2025, 02:29 PM UTC
**Incident explanation:** Maintenance that was supposed to be transparent led to delays in sending some scheduled exports. **Actions performed:** Maintenance done without other issue. **Actions to come:** No more action needed.
Read the full incident report →
- Detected by Pingoru
- Jul 08, 2025, 05:59 AM UTC
- Resolved
- Jul 08, 2025, 08:19 AM UTC
- Duration
- 2h 20m
Affected: Composer Experience Execution - USAPI Endpoints - cxense - api.cxense.com
Timeline · 4 updates
-
investigating Jul 08, 2025, 05:59 AM UTC
Audience Segment lookup is failing in the US region (/profile/user/segment and /segment/lookup APIs not returning results) The issue also affects Composer's user segmentation based on Audience segments. (US region only) Engineers are investigating.
-
identified Jul 08, 2025, 06:10 AM UTC
The issue has been identified and a fix is being implemented.
-
monitoring Jul 08, 2025, 07:06 AM UTC
A fix has been implemented and we are monitoring the results.
-
resolved Jul 08, 2025, 08:19 AM UTC
This incident has been resolved.
Read the full incident report →
- Detected by Pingoru
- Jun 24, 2025, 03:30 PM UTC
- Resolved
- Jun 24, 2025, 05:14 PM UTC
- Duration
- 1h 43m
Affected: Other
Timeline · 3 updates
-
identified Jun 24, 2025, 03:30 PM UTC
Our devs have identified an issue where my account widget isn't loading. The content loads after a refresh or multiple refreshes in some instances. Our devs are working on a fix and will post an update as soon as it is available.
-
monitoring Jun 24, 2025, 03:40 PM UTC
Our developers implemented a fix on all Piano dashboard environments. We are monitoring the performance, and any advances will be updated here.
-
resolved Jun 24, 2025, 05:14 PM UTC
This incident has been resolved
Read the full incident report →
- Detected by Pingoru
- Jun 23, 2025, 11:31 AM UTC
- Resolved
- Jun 23, 2025, 01:23 PM UTC
- Duration
- 1h 51m
Affected: Piano ID and VX transactional Emails
Timeline · 2 updates
-
investigating Jun 23, 2025, 11:31 AM UTC
We are currently experiencing delays with VX email sending across all environments (US, EU, AP, AU) impacting applications using Mandrill as the email service provider. Our team is actively investigating the issue.
-
resolved Jun 23, 2025, 01:23 PM UTC
The issue has been identified and resolved. The incident took place between 08:30 and 11:15 UTC. Our investigation confirmed that email delivery was not affected. The impact was limited to specific internal Mandrill - Piano webhook deliveries, which have now returned to normal functionality.
Read the full incident report →
- Detected by Pingoru
- Jun 23, 2025, 09:27 AM UTC
- Resolved
- Jun 24, 2025, 05:18 PM UTC
- Duration
- 1d 7h
Affected: API Endpoints - cxense - api.cxense.comPiano Insight DashboardPiano DMP Dashboard
Timeline · 9 updates
Read the full incident report →