Langfuse incident

Degraded OTEL ingestion in US region

Resolved after 53 minutes, affecting EU (cloud.langfuse.com) (Ingestion API) and US (us.cloud.langfuse.com) (Ingestion API) and 1 more, on September 2, 2026.

resolved Sep 02, 2026, 04:56 PM UTC

Completely back to normal

Started
Sep 02, 2026, 04:02 PM UTC
Resolved
Sep 02, 2026, 04:56 PM UTC
Duration
53m
Detected by Pingoru
Sep 02, 2026, 04:02 PM UTC

Affected components

EU (cloud.langfuse.com) (Ingestion API)US (us.cloud.langfuse.com) (Ingestion API)HIPAA (hipaa.cloud.langfuse.com) (Ingestion API)JP (jp.cloud.langfuse.com (Ingestion API)

Update timeline

  1. investigating Sep 02, 2026, 04:02 PM UTC

    We are observing OTEL ingestion backlog in US region

  2. investigating Sep 02, 2026, 04:02 PM UTC

    We are observing OTEL ingestion backlog in US region

  3. identified Sep 02, 2026, 04:24 PM UTC

    A deployment rollout coincided with a traffic spike, resulting in an unusually large backlog. Adjusting our autoscaling to absorb the backlog faster.

  4. identified Sep 02, 2026, 04:24 PM UTC

    A deployment rollout coincided with a traffic spike, resulting in an unusually large backlog. Adjusting our autoscaling to absorb the backlog faster.

  5. monitoring Sep 02, 2026, 04:49 PM UTC

    Backlog is almost completely gone. Ingestion delay is < 1 min.

  6. monitoring Sep 02, 2026, 04:49 PM UTC

    Backlog is almost completely gone. Ingestion delay is < 1 min.

  7. resolved Sep 02, 2026, 04:56 PM UTC

    Completely back to normal

  8. resolved Sep 02, 2026, 04:56 PM UTC

    Completely back to normal

  9. resolved Sep 02, 2026, 04:56 PM UTC

    Completely back to normal

Your product runs on more than Langfuse

Add the vendors you depend on and get one message when any of them reports trouble. Free for 3 vendors, no card.

Add your stack →