Etleap incident

We are currently unable to receive event requests for Event Stream pipelines in the EU

Critical Resolved View vendor source →

Etleap experienced a critical incident on March 13, 2025 affecting UI and Pipelines and 1 more component, lasting 3h 37m. The incident has been resolved; the full update timeline is below.

Started
Mar 13, 2025, 11:03 AM UTC
Resolved
Mar 13, 2025, 02:41 PM UTC
Duration
3h 37m
Detected by Pingoru
Mar 13, 2025, 11:03 AM UTC

Affected components

UIPipelinesEvent Streams

Update timeline

  1. investigating Mar 13, 2025, 11:03 AM UTC

    We are actively investigating the root cause of the issue. Only the hosted EU environment (app.eu.etleap.com) is impacted by this.

  2. identified Mar 13, 2025, 12:29 PM UTC

    We are also seeing some timeouts occur in DMS which is causing latency for some CDC pipelines. We have identified the cause as a networking throughput issue and are actively working on a resolution.

  3. identified Mar 13, 2025, 02:05 PM UTC

    We are continuing to address the root cause of the issue. We have started recovering the CDC pipelines and are starting to see them recover. The event streams have recovered and are operational. The UI is currently down and we are working to recover it now.

  4. monitoring Mar 13, 2025, 02:22 PM UTC

    A fix has been implemented and we are monitoring the results.

  5. resolved Mar 13, 2025, 02:41 PM UTC

    The incident has been resolved and affected pipelines have recovered.