Orbee incident

Intermittent Outages in Automated Email System

Major Resolved View vendor source →

Orbee experienced a major incident on March 30, 2023 affecting Email Marketing, lasting 8d 15h. The incident has been resolved; the full update timeline is below.

Started
Mar 30, 2023, 12:06 AM UTC
Resolved
Apr 07, 2023, 03:33 PM UTC
Duration
8d 15h
Detected by Pingoru
Mar 30, 2023, 12:06 AM UTC

Affected components

Email Marketing

Update timeline

  1. investigating Mar 30, 2023, 12:06 AM UTC

    We are currently investigating an issue related to our automated email system. Since March 8, 2023, we have observed intermittent outages in the system, resulting in emails not being sent on a daily basis. Our engineering team has been notified of this issue and is working diligently to identify and resolve the underlying cause. After a preliminary investigation, our team has identified a potential issue that may be responsible for the email system's irregular behavior. We are conducting further analysis to determine the root cause and implement a permanent fix. We understand the importance of our email marketing and notifications, and we want to assure you that we are actively addressing this issue. Our team is working to restore the service to its normal operation as quickly as possible. We will update as soon as we have more information. Impacted Automated Emails - Viewed Vehicle Emails (“Still shopping?”) - Price Drop Emails (“Vehicle Price Drop Alert!”) - Vehicle Favorite (“Here are your favorited vehicles”) Impacted Notifications - Lead Reactivation Reports - Lead Reactivation ADF

  2. identified Mar 30, 2023, 04:54 AM UTC

    This issue has been identified and is related to an issue affecting automated email notifications that utilize Dealer Socker data. Resolution of this other issue should also resolve these irregularities with our automated email marketing.

  3. monitoring Mar 30, 2023, 02:07 PM UTC

    A fix has been deployed and automated email notifications successfully sent this morning, we will continue to monitor the situation

  4. resolved Apr 07, 2023, 03:33 PM UTC

    This incident has been resolved.