Trigger.dev incident

Run logs are being dropped

Minor Resolved View vendor source →

Trigger.dev experienced a minor incident on September 28, 2026 affecting Global (OpenTelemetry), lasting 30m. The incident has been resolved; the full update timeline is below.

Started
Sep 28, 2026, 07:20 AM UTC
Resolved
Sep 28, 2026, 07:50 AM UTC
Duration
30m
Detected by Pingoru
Sep 28, 2026, 07:20 AM UTC

Affected components

Global (OpenTelemetry)

Update timeline

  1. investigating Sep 28, 2026, 07:20 AM UTC

    We're investigating run logs being dropped (from your run when you do console.log/logger.log). This doesn't impact run operation but does impact observability. This isn't due to a code or configuration change. More information soon.

  2. resolved Sep 28, 2026, 07:50 AM UTC

    Logs are being fully ingested again. The issue was with the internal workers in our shared OpenTelemetry service. They became unhealthy but weren't rolled. We're looking into why and how to prevent this from happening again.