Camunda incident

Degraded performance of some services

Major Resolved View vendor source →

Camunda experienced a major incident on November 27, 2023 affecting Connectors and Operate and 1 more component, lasting 14h 6m. The incident has been resolved; the full update timeline is below.

Started
Nov 27, 2023, 05:43 PM UTC
Resolved
Nov 28, 2023, 07:49 AM UTC
Duration
14h 6m
Detected by Pingoru
Nov 27, 2023, 05:43 PM UTC

Affected components

ConnectorsOperateTasklistZeebe

Update timeline

  1. investigating Nov 27, 2023, 04:09 PM UTC

    We are currently investigation the degraded performance.

  2. investigating Nov 27, 2023, 04:32 PM UTC

    We are continuing to investigate this issue.

  3. investigating Nov 27, 2023, 05:42 PM UTC

    We are continuing to investigate this issue.

  4. investigating Nov 27, 2023, 05:43 PM UTC

    We have found the root cause of the issue. Some Camunda clusters are affected and are currently unhealthy. We are working on restoring them.

  5. investigating Nov 27, 2023, 05:54 PM UTC

    We have found the root cause of the issue. Some Camunda clusters are affected and are currently unhealthy. We are working on restoring them.

  6. identified Nov 27, 2023, 07:03 PM UTC

    We are still working on restoring the clusters.

  7. identified Nov 27, 2023, 08:40 PM UTC

    Zeebe was not impacted was this issue and kept processing data the entire time. We have identified the affected Camunda clusters, and we are still working on restoring the availability for Connectors, Operate and Tasklist on these clusters. Further communication will be sent to the affected customers directly.

  8. identified Nov 28, 2023, 04:18 AM UTC

    Zeebe was not impacted by this issue and kept processing data the entire time. Engineering teams are still working on restoring the availability for Connectors, Operate and Tasklist on the affected Camunda clusters. We directly reached out to most of the affected customers already.

  9. resolved Nov 28, 2023, 07:49 AM UTC

    The availability of affected clusters has been restored and Connectors, Operate and Tasklist services are running again. We are in touch with the affected customers to discuss further steps.