OpsGenie incident

Increased delays on all flows in EU region

Minor Resolved View vendor source →

OpsGenie experienced a minor incident on June 26, 2023 affecting Alert Flow and Email Notification Delivery and 1 more component, lasting 6h 10m. The incident has been resolved; the full update timeline is below.

Started
Jun 26, 2023, 06:25 AM UTC
Resolved
Jun 26, 2023, 12:36 PM UTC
Duration
6h 10m
Detected by Pingoru
Jun 26, 2023, 06:25 AM UTC

Affected components

Alert FlowEmail Notification DeliverySMS Notification DeliveryVoice Notification DeliveryMobile Notification DeliveryHeartbeat MonitoringIncoming Integration FlowOutgoing Integration FlowSignup, Login & AuthorizationWeb Application

Update timeline

  1. investigating Jun 26, 2023, 06:25 AM UTC

    Our platform is experiencing some delays for all system in EU region. Team is actively working on it to mitigate the delays. We'll keep you posted with further updates.

  2. investigating Jun 26, 2023, 06:30 AM UTC

    The team has identified the cause of the problem and actively working on it to mitigate the delays.

  3. identified Jun 26, 2023, 06:30 AM UTC

    The issue has been identified and a fix is being implemented.

  4. identified Jun 26, 2023, 07:42 AM UTC

    We are continuing on a fix for the issue.

  5. identified Jun 26, 2023, 09:44 AM UTC

    We detected delays in login flow. We identified the problem and working on fix.

  6. identified Jun 26, 2023, 11:49 AM UTC

    Due to extreme load, we are experiencing problem in cache layer. Our team is actively addressing the problem and working on implementing a fix as quickly as possible. We appreciate your patience.

  7. monitoring Jun 26, 2023, 12:33 PM UTC

    Our engineering team has implemented fixes. We are monitoring all systems. Thank you for your patience.

  8. resolved Jun 26, 2023, 12:36 PM UTC

    Our engineers have been closely monitoring the platform and are declaring this incident resolved. Thank you for your patience.