Piano.io incident

[Activation] Webhook Delivery Issue (US Region)

Minor Resolved View vendor source →
Started
Mar 06, 2026, 01:10 PM UTC
Resolved
Mar 06, 2026, 06:05 PM UTC
Duration
4h 55m
Detected by Pingoru
Mar 06, 2026, 01:10 PM UTC

Update timeline

  1. resolved Mar 06, 2026, 06:05 PM UTC

    Mar 6, 18:05 UTC Resolved - The issue has been resolved, and the team will continue working on restoring the missing events. Mar 6, 13:31 UTC Monitoring - We have successfully implemented a fix for the webhook payload issue. New events are now being delivered with correct content again. To expedite the resolution, events were rerouted to a new table, which means historical events from before 13:31 UTC are temporarily unavailable while we work on restoring them. We're actively monitoring the system and continuing restoration efforts, though our preliminary assessment indicates that data from the affected time period (11:20 UTC - 13:31 UTC) may not be completely recoverable. Mar 6, 13:27 UTC Update - We have identified an issue causing corrupted webhook payloads for a subset of users. Due to a database limitation where a foreign key column hit its maximum value, webhooks may contain corrupted metadata fields, including malformed data like '*mac.com' instead of correct information. Our team is actively working on a fix, and we'll keep you updated on our progress. Mar 6, 13:10 UTC Identified - We’re currently experiencing an issue affecting webhook deliveries in the US region. Some webhooks may fail or contain invalid data. Our team has identified the cause and is actively working on a fix. Updates will follow as more information becomes available.

Looking to track Piano.io downtime and outages?

Pingoru polls Piano.io's status page every 5 minutes and alerts you the moment it reports an issue — before your customers do.

  • Real-time alerts when Piano.io reports an incident
  • Email, Slack, Discord, Microsoft Teams, and webhook notifications
  • Track Piano.io alongside 5,000+ providers in one dashboard
  • Component-level filtering
  • Notification groups + maintenance calendar
Start monitoring Piano.io for free

5 free monitors · No credit card required