Honeycomb.io incident

SLO and Trigger webhook notifications with irregular payloads

Notice Resolved View vendor source →

Honeycomb.io experienced a notice incident on December 19, 2024 affecting ui.honeycomb.io - US1 Trigger & SLO Alerting and ui.eu1.honeycomb.io - EU1 Trigger & SLO Alerting, lasting 45m. The incident has been resolved; the full update timeline is below.

Started
Dec 19, 2024, 01:39 AM UTC
Resolved
Dec 19, 2024, 02:25 AM UTC
Duration
45m
Detected by Pingoru
Dec 19, 2024, 01:39 AM UTC

Affected components

ui.honeycomb.io - US1 Trigger & SLO Alertingui.eu1.honeycomb.io - EU1 Trigger & SLO Alerting

Update timeline

  1. identified Dec 19, 2024, 01:39 AM UTC

    We have identified an issue with webhook targets on triggers and SLOs that result in irregular payloads. We are working on correcting the situation

  2. monitoring Dec 19, 2024, 01:56 AM UTC

    The problematic code change has been spotted and corrected. Overall we believe the problem started for webhooks at roughly 21:53 UTC and stopped at 01:46 UTC.

  3. resolved Dec 19, 2024, 02:25 AM UTC

    We have confirmed the new build to have fixed the issue.