Piano.io incident

Europe - Composer - Experiences targeting custom fields are failing

Resolved after 4 hours 11 minutes, affecting Composer Experience Execution - Europe, on May 13, 2026.

postmortem May 15, 2026, 09:39 AM UTC

An infrastructure update to the EU environment introduced an incompatibility that prevented Composer from retrieving Custom Fields. The issue was limited to the EU region and did not affect other environments. The update introduced a behavioural change in the network routing layer where a configuration setting that had previously been relied upon was no longer honoured under the new setup. This incompatibility was not detected during pre-production testing, as the test environments did not fully replicate the conditions needed to surface the issue. The root cause was identified and the configuration gap was addressed promptly. Piano is taking steps to improve parity between pre-production and production environments and to strengthen the validation process ahead of future infrastructure changes to prevent similar issues.

Started
May 13, 2026, 01:48 PM UTC
Resolved
May 13, 2026, 06:00 PM UTC
Duration
4h 11m
Detected by Pingoru
May 13, 2026, 01:48 PM UTC

Affected components

Composer Experience Execution - Europe

Update timeline

  1. investigating May 13, 2026, 01:48 PM UTC

    We are currently investigating issues affecting the execution of experiences in our European region for segmentation that relies on custom field rules. Impacted users may notice that experiences are not triggering as expected, not reaching the desired outcome. Our engineering team is actively investigating the issue.

  2. monitoring May 13, 2026, 02:02 PM UTC

    The issue has been identified and fixed; we're currently monitoring the experience executions.

  3. resolved May 13, 2026, 06:00 PM UTC

    This incident has been resolved.

  4. postmortem May 15, 2026, 09:39 AM UTC

    An infrastructure update to the EU environment introduced an incompatibility that prevented Composer from retrieving Custom Fields. The issue was limited to the EU region and did not affect other environments. The update introduced a behavioural change in the network routing layer where a configuration setting that had previously been relied upon was no longer honoured under the new setup. This incompatibility was not detected during pre-production testing, as the test environments did not fully replicate the conditions needed to surface the issue. The root cause was identified and the configuration gap was addressed promptly. Piano is taking steps to improve parity between pre-production and production environments and to strengthen the validation process ahead of future infrastructure changes to prevent similar issues.

Your product runs on more than Piano.io

Add the vendors you depend on and get one message when any of them reports trouble. Free for 3 vendors, no card.

Add your stack →