OpsGenie incident

Reported issues with OEC functionality

Major Resolved View vendor source →

OpsGenie experienced a major incident on September 24, 2024 affecting Outgoing Integration Flow and Outgoing Integration Flow, lasting 59m. The incident has been resolved; the full update timeline is below.

Started
Sep 24, 2024, 07:55 PM UTC
Resolved
Sep 24, 2024, 08:54 PM UTC
Duration
59m
Detected by Pingoru
Sep 24, 2024, 07:55 PM UTC

Affected components

Outgoing Integration FlowOutgoing Integration Flow

Update timeline

  1. investigating Sep 24, 2024, 07:55 PM UTC

    We've been notified that a number of OEC clients have been failing to create Jira tickets. We're currently investigating the issue.

  2. investigating Sep 24, 2024, 07:56 PM UTC

    We are continuing to investigate this issue.

  3. identified Sep 24, 2024, 08:22 PM UTC

    We've identified a recent change that has broken some endpoint routing configurations and caused OEC endpoint requests to be directed to wrong service. We're reverting that change on production at the moment.

  4. monitoring Sep 24, 2024, 08:49 PM UTC

    We reverted the faulty routing configuration change and started getting traffic on OEC endpoints

  5. resolved Sep 24, 2024, 08:54 PM UTC

    We've verified that OEC endpoints are back online.