Honeycomb.io incident

Ingest and processing delays

Minor Resolved View vendor source →

Honeycomb.io experienced a minor incident on November 6, 2024 affecting api.honeycomb.io - US1 Event Ingest and ui.honeycomb.io - US1 Querying and 1 more component, lasting 5h 35m. The incident has been resolved; the full update timeline is below.

Started
Nov 06, 2024, 03:40 PM UTC
Resolved
Nov 06, 2024, 09:15 PM UTC
Duration
5h 35m
Detected by Pingoru
Nov 06, 2024, 03:40 PM UTC

Affected components

api.honeycomb.io - US1 Event Ingestui.honeycomb.io - US1 Queryingui.honeycomb.io - US1 Trigger & SLO Alerting

Update timeline

  1. investigating Nov 06, 2024, 03:40 PM UTC

    We are investigating increased latency in our ingest pipeline. We are seeing slow but steady recovery. Triggers and SLOs appear to be operational but we are monitoring the situation closely.

  2. investigating Nov 06, 2024, 04:27 PM UTC

    We are working on a fix to address the increased latency. We are seeing slow but steady recovery. Triggers and SLOs appear to be operational and unimpacted but we are monitoring the situation closely.

  3. resolved Nov 06, 2024, 09:15 PM UTC

    We have seen full recovery of our querying in Production US.