Langfuse incident

Degraded ingestion for 20 projects

Resolved after 6 hours 20 minutes, affecting EU (cloud.langfuse.com) (Ingestion API) and US (us.cloud.langfuse.com) (Ingestion API) and 1 more, on September 30, 2026.

resolved Sep 30, 2026, 03:30 PM UTC

All projects ingesting as normal

Started
Sep 30, 2026, 09:10 AM UTC
Resolved
Sep 30, 2026, 03:30 PM UTC
Duration
6h 20m
Detected by Pingoru
Sep 30, 2026, 09:10 AM UTC

Affected components

EU (cloud.langfuse.com) (Ingestion API)US (us.cloud.langfuse.com) (Ingestion API)HIPAA (hipaa.cloud.langfuse.com) (Ingestion API)JP (jp.cloud.langfuse.com (Ingestion API)

Update timeline

  1. identified Sep 30, 2026, 09:10 AM UTC

    S3 backpressure leads to S3 "please slow down" errors across projects with cm* prefix

  2. identified Sep 30, 2026, 09:10 AM UTC

    S3 backpressure leads to S3 "please slow down" errors across projects with cm* prefix

  3. monitoring Sep 30, 2026, 09:43 AM UTC

    Offending workload was isolated, performance should be back to normal for other projects

  4. monitoring Sep 30, 2026, 09:43 AM UTC

    Offending workload was isolated, performance should be back to normal for other projects

  5. resolved Sep 30, 2026, 03:30 PM UTC

    All projects ingesting as normal

  6. resolved Sep 30, 2026, 03:30 PM UTC

    All projects ingesting as normal

  7. resolved Sep 30, 2026, 03:30 PM UTC

    All projects ingesting as normal

Your product runs on more than Langfuse

Add the vendors you depend on and get one message when any of them reports trouble. Free for 3 vendors, no card.

Add your stack →