Honeycomb.io incident

SampleRate processing impaired

Notice Resolved View vendor source →

Honeycomb.io experienced a notice incident on November 13, 2024 affecting api.honeycomb.io - US1 Event Ingest and api.eu1.honeycomb.io - EU1 Event Ingest, lasting 13m. The incident has been resolved; the full update timeline is below.

Started
Nov 13, 2024, 07:15 PM UTC
Resolved
Nov 13, 2024, 07:28 PM UTC
Duration
13m
Detected by Pingoru
Nov 13, 2024, 07:15 PM UTC

Affected components

api.honeycomb.io - US1 Event Ingestapi.eu1.honeycomb.io - EU1 Event Ingest

Update timeline

  1. investigating Nov 13, 2024, 07:15 PM UTC

    Honeycomb has been ignoring the “SampleRate” attribute in OTLP telemetry for the past 19 hours. “sampleRate” with a lower-case S is being processed as normal. Telemetry sent using Beelines is also being processed as normal. We're currently deploying a fix and will post an update soon.

  2. monitoring Nov 13, 2024, 07:22 PM UTC

    We have deployed a fix and we are currently monitoring to ensure resolution. At this time we expect that SampleRate processing is working as usual.

  3. resolved Nov 13, 2024, 07:28 PM UTC

    Processing of the SampleRate attribute with a capital S is restored. This incident is now resolved.