MoEngage incident

[dashboard - 01] Service degradation in multiple services

Minor Resolved View vendor source →

MoEngage experienced a minor incident on September 29, 2023 affecting Data Processing and One-time & Periodic Campaigns - Mobile Push & Web Push and 1 more component, lasting 5h 8m. The incident has been resolved; the full update timeline is below.

Started
Sep 29, 2023, 02:34 AM UTC
Resolved
Sep 29, 2023, 07:42 AM UTC
Duration
5h 8m
Detected by Pingoru
Sep 29, 2023, 02:34 AM UTC

Affected components

Data ProcessingOne-time & Periodic Campaigns - Mobile Push & Web PushOne-time & Periodic Campaigns - EmailOne-time & Periodic Campaigns - SMSOne-time & Periodic Campaigns - ConnectorsOne-time & Periodic Campaigns - FlowsDashboardEvent Triggered Campaigns and FlowsOne-time & Periodic Campaigns - Facebook Audience

Update timeline

  1. investigating Sep 29, 2023, 02:34 AM UTC

    We are experiencing service degradation in multiple services on Dashboard-01. We will provide more details on this issue as soon as possible. We are working on this to resolve it as soon as possible. Kindly bear with us while we do it. Appreciate your understanding and cooperation in this regard. Please reach out to [email protected] in case of any queries. Thanks, Team MoEngage

  2. monitoring Sep 29, 2023, 03:11 AM UTC

    Our Infrastructure provider, AWS, has been facing issues at their end for the last few hours. We are actively working with their team to restore the MoEngage services. Data ingestion and reflection are delayed by 90 minutes. One-time campaigns - push, email, and SMS were delayed by 1-hour delay 30 mins ago, but as of now, one-time campaigns are sent at their scheduled time.

  3. monitoring Sep 29, 2023, 03:43 AM UTC

    Customers using Push campaign APIs to trigger the messages to end users should retry the APIs to send the campaigns now. We deeply regret for this inconvenience.

  4. monitoring Sep 29, 2023, 04:32 AM UTC

    There is no lag in executing the Smart triggers and Flows. Data ingestion is still delayed by 1 hour. Campaigns that are sent through push APIs and considered non transactional are delayed by 1 hour. We will keep you posted on the updates soon.

  5. monitoring Sep 29, 2023, 06:17 AM UTC

    We continue to see a data ingestion delay of 1 hr. All the other services are working as expected.

  6. resolved Sep 29, 2023, 07:42 AM UTC

    All the services are back to normal. We will do an RCA of this incident internally and work towards the measures to prevent such issues.