Piano.io incident

Traffic drop - Piano Insight

Major Resolved View vendor source →

Piano.io experienced a major incident on November 13, 2025 affecting Composer Experience Execution - US and Composer Experience Execution - Europe and 1 more component, lasting 22h 19m. The incident has been resolved; the full update timeline is below.

Started
Nov 13, 2025, 09:29 AM UTC
Resolved
Nov 14, 2025, 07:49 AM UTC
Duration
22h 19m
Detected by Pingoru
Nov 13, 2025, 09:29 AM UTC

Affected components

Composer Experience Execution - USComposer Experience Execution - EuropeAPI Endpoints - cxense - api.cxense.comInsight Data collectionPiano Insight Dashboard

Update timeline

  1. identified Nov 13, 2025, 09:29 AM UTC

    We noticed a significant traffic drop in Insight started on November 12, 2025 17:07 UTC. Technical team identified the root cause and now working on the resolution.

  2. identified Nov 13, 2025, 09:54 AM UTC

    We are continuing to work on a fix for this issue.

  3. identified Nov 13, 2025, 12:08 PM UTC

    We are continuing to work on a fix for this issue.

  4. identified Nov 13, 2025, 12:48 PM UTC

    We are continuing to work on a fix for this issue.

  5. identified Nov 13, 2025, 01:09 PM UTC

    All traffic events were restored, team is now working on restoring stability on data cubes and depending services. Composer1x segmentation was affected and experience execution results might not be accurate because of that.

  6. identified Nov 13, 2025, 10:01 PM UTC

    The service stability has been fully restored across all regions except for Europe. Our teams continue to work diligently to restore the remaining region. Composer1x segmentation can still be affected, and the experience execution results might not be accurate because of that.

  7. monitoring Nov 14, 2025, 01:06 AM UTC

    The issue has been resolved, and services are operating normally. We are continuing to monitor the situation to ensure ongoing stability.

  8. resolved Nov 14, 2025, 07:49 AM UTC

    All systems have been restored and operating properly now.