Orbee Outage History

Started Oct 08, 2026, 10:56 PM UTC· resolved Oct 08, 2026, 11:31 PM UTC

1. investigating Oct 08, 2026, 10:56 PM UTC

   Some users are unable to create or edit email templates because the editor is stuck on “Loading.” Previously created and deployed templates may be unaffected. We’re investigating. An outage with our email editor provider could be causing requests to time out.

2. resolved Oct 08, 2026, 11:31 PM UTC

   Our email editor provider has resolved the outage and its status page now reports “All Systems Operational.” We’re confirming template editing is working again in Orbee.

Read the full incident report →

Started Aug 14, 2026, 10:59 PM UTC· resolved Aug 15, 2026, 03:49 AM UTC

1. identified Aug 14, 2026, 10:59 PM UTC

   We have identified degraded performance in a portion of our customer data warehouse system, causing the nodes to fall behind in their replication process. We've isolated the affected nodes and are working on getting them back up-and-running. At this time, customers can read their data using Data Studio and the associated Record views. Ingesting new data and changing schemas for native objects are queued but not being processed at this time. We'll provide another update as soon as we get the affected nodes back up-and-running.

2. identified Aug 15, 2026, 01:00 AM UTC

   50% of the affected replication nodes are now healthy; we are continuing to work on getting the remaining nodes back into an operational state. Querying data continues to not be affected.

3. monitoring Aug 15, 2026, 02:57 AM UTC

   All nodes are now functional and operating normally. There is no inconsistent behavior anymore, and all queued schema changes and data ingestion are running normally. We'll continue to monitor to verify that the nodes remain healthy and that everything wraps up accordingly.

4. resolved Aug 15, 2026, 03:49 AM UTC

   The issue is now fully resolved, and monitoring has shown all operations has gone back to normal. Normal database maintenance and optimization operations in the background combined with a node reboot caused some replica nodes to enter a long, blocking startup phase that required cleanup of the incomplete processes as well as normal startup operations. During this time, the node would still accept queries but not have the capacity to execute them, causing connections and queries to hang. These queries would persist, queued, and cause the node to fail performance-wise following startup, causing another reboot. This then triggered the process all over again. Once the affected nodes were quarantined, query operations resumed normally on healthy nodes. We also paused the running of schema and ingestion tasks, which queued instead. This allowed the nodes to complete the startup and optimization processes without impedance. Once the nodes were operational they could rejoin the cluster and resume accepting queries. Once the cluster was fully healed, all operations could resume. The ingestion + schema changes ran into no roadblocks and query performance continued to perform normally. Alerts and quarantine automation have been created to handle this situation in the future with much faster resolution times and little to no noticeable changes to performance and capabilities in the Platform.

Read the full incident report →

Started Jun 01, 2026, 05:04 PM UTC· resolved Jun 02, 2026, 02:09 AM UTC

1. identified Jun 01, 2026, 05:04 PM UTC

   We are experiencing a partial outage affecting Data Studio. We are actively working to resolve the issue and will provide regular updates until full functionality is restored.

2. monitoring Jun 01, 2026, 06:27 PM UTC

   A fix has been implemented and we are monitoring the results

3. resolved Jun 02, 2026, 02:09 AM UTC

   This incident has been resolved.

Read the full incident report →

Started Apr 19, 2026, 09:49 PM UTC· resolved Apr 19, 2026, 09:49 PM UTC

1. monitoring Apr 22, 2026, 04:00 AM UTC

   THIS IS A SCHEDULED EVENT Apr 21, 21:00 - 23:00 PDT Apr 16, 12:49 PDT Scheduled - We will be undergoing scheduled maintenance during this time.

Read the full incident report →

Started Feb 22, 2026, 09:00 AM UTC· resolved Feb 22, 2026, 09:00 AM UTC

1. monitoring Feb 22, 2026, 09:00 AM UTC

   Feb 22, 01:00 PST Completed - The scheduled maintenance has been completed. Feb 21, 19:00 PST In progress - Scheduled maintenance is currently in progress. We will provide updates as necessary. Jan 13, 09:52 PST Scheduled - We will be undergoing scheduled maintenance during this time

Read the full incident report →

Started Jan 17, 2026, 07:46 PM UTC· resolved Jan 17, 2026, 07:46 PM UTC

1. monitoring Jan 17, 2026, 07:46 PM UTC

   Jan 17, 11:46 PST Resolved - This incident has been resolved. Jan 17, 11:30 PST Monitoring - A fix has been implemented and the Platform has shown a recovery in performance. We'll continue to monitor the fix to make sure things remain performant. Jan 17, 11:20 PST Identified - We have identified an issue with the Orbee Platform's Reporting Dashboards and Views, related to a read replica with degraded performance from our cloud provider. We're isolating the usage of the instance and working on getting database reads working with acceptable performance again. During this time, you may see reporting dashboards show poor load times, or fail to load.

Read the full incident report →

Started Dec 16, 2025, 11:26 PM UTC· resolved Dec 16, 2025, 11:26 PM UTC

1. monitoring Dec 16, 2025, 11:26 PM UTC

   Dec 16, 15:26 PST Resolved - This incident has been resolved. Dec 11, 17:59 PST Monitoring - We have implemented a fix and we are monitoring the results. Dec 11, 10:32 PST Investigating - Our data processing infrastructure is running behind which is causing delays in our audience building tool and by extension is impacting email marketing tools. Uploading third-party lists is still available as an option to add create email marketing audience.

Read the full incident report →

Started Nov 25, 2025, 07:16 PM UTC· resolved Nov 25, 2025, 07:16 PM UTC

1. monitoring Nov 25, 2025, 07:16 PM UTC

   Nov 25, 11:16 PST Resolved - We have resolved the issue affecting legacy VinSolutions data ingestion. We completed a manual synchronization and migration to ensure all data tables are now current. We verified that automated email workflows and audiences are querying up-to-date data. We also determined that other data sources were not impacted and remain fully operational. Nov 20, 15:21 PST Investigating - We’re currently investigating an issue affecting performance for customers using the legacy VinSolutions integration. This may impact data availability for select audiences and automated email workflows. Our VinSolutions v2 integration remains fully operational. Our engineering team is actively working to resolve the issue. We’ll provide updates as more information becomes available.

Read the full incident report →

Started Oct 22, 2025, 02:22 AM UTC· resolved Oct 22, 2025, 02:22 AM UTC

1. monitoring Oct 22, 2025, 02:22 AM UTC

   Oct 21, 19:22 PDT Completed - The scheduled maintenance has been completed. Oct 21, 19:00 PDT In progress - Scheduled maintenance is currently in progress. We will provide updates as necessary. Oct 20, 13:08 PDT Scheduled - We will be undergoing maintenance during this time.

Read the full incident report →

Started Oct 21, 2025, 12:27 AM UTC· resolved Oct 21, 2025, 12:27 AM UTC

1. monitoring Oct 21, 2025, 12:27 AM UTC

   Oct 20, 17:27 PDT Resolved - AWS has reported the outage has been resolved as of 4 PM PST. Oct 20, 12:16 PDT Monitoring - Orbee is monitoring the current AWS Outage and maintaining our service uptime. As of 12 PM PST, no services have had any issues, outages or downtime at Orbee. We will continue to monitor the AWS outage and address any issues we do see come up.

Read the full incident report →

Started Jul 11, 2025, 04:35 PM UTC· resolved Jul 11, 2025, 06:10 PM UTC

1. resolved Jul 11, 2025, 06:16 PM UTC

   For about an 90 minutes from 4:35 PM UTC to 6:10PM UTC, users experienced slower administration API and UI performance (listing accounts and navigating the platform). This was caused by a reoccurring background job taking more resources than normal this morning. We have since rectified the issue and the platform and APIs are performing normally again.

Read the full incident report →

Started Jul 02, 2025, 04:30 PM UTC· resolved Jul 03, 2025, 08:38 PM UTC

1. monitoring Jul 03, 2025, 03:45 AM UTC

   We are currently monitoring an incident originating from Google Ads which has impacted multiple advertising-related services. These disruptions include delays or inconsistencies in reporting, audience syncing, campaign delivery, and budget updates. Google has identified and resolved the root issue, as detailed on their status dashboard. The incident spanned approximately 11 hours and affected Google Ads and Search Ads 360. While Google services have been marked as recovered, Orbee systems that rely on these integrations may still show delayed data propagation or partial functionality in the short term. Our engineering team is validating system stability and ensuring that all downstream effects are fully resolved. We will provide an update once all affected components are confirmed to be operating normally.

2. resolved Jul 03, 2025, 08:38 PM UTC

   The incident stemming from a Google Ads API outage has been resolved. This incident impacted Orbee’s advertising-related services, including audience list creation, campaign delivery, reporting, and budget management. Google confirmed that the issue was active between July 2, 2025, 16:30 UTC (9:30 AM PT) and July 3, 2025, 03:30 UTC (July 2, 8:30 PM PT), and has since marked their systems as operational. Our teams have validated that all related API endpoints are now functioning as expected. Functionality for ad creation, audience syncing, and budget management has been confirmed across all affected systems. You can find additional details here: https://ads.google.com/status/publisher/incidents/xF9wKox7evao5WupR7mu No further issues are expected at this time.

Read the full incident report →

Started Jun 12, 2025, 09:44 PM UTC· resolved Jun 13, 2025, 04:03 AM UTC

1. monitoring Jun 12, 2025, 09:44 PM UTC

   We are aware of a widespread outage affecting data centers globally. Orbee core services and infrastructure are NOT directly impacted by this incident. We are actively monitoring the situation and will provide further updates here if there are any changes or if the outage affects our core services.

2. resolved Jun 13, 2025, 04:03 AM UTC

   The data centers impacted by the global outage have recovered. Orbee core services were not affected, and we continue to monitor for any residual issues.

Read the full incident report →

Started Mar 27, 2025, 03:58 PM UTC· resolved Mar 31, 2025, 09:50 PM UTC

1. investigating Mar 27, 2025, 03:58 PM UTC

   We are currently investigating an issue experienced by some customers intermittently, where automated emails going out can sometimes be missing vehicle images when referencing their ingested inventory. We will provide an update once a cause for this issue has been identified.

2. identified Mar 27, 2025, 04:24 PM UTC

   We have identified that the inventory image download queue is currently lagging. Therefore, this issue only affects vehicles made available in the dealer's inventory feed within the past 72 hours that are already being marketed to customers in automated emails. We have already increased the amount of processing we support for this queue, and will continue to monitor the situation and identify why the queue fell behind. We'll provide another update on the progress of getting this image download queue back under control.

3. monitoring Mar 27, 2025, 06:15 PM UTC

   A hotfix has been implemented in the meantime and we do see images showing up again for many vehicles. We will continue to monitor the situation as the rest of the image processing queue finishes processing.

4. monitoring Mar 28, 2025, 04:18 PM UTC

   We are continuing to monitor the image queue as it gets back to normal. Vehicle images are largely back up and working but we will continue to monitor while new inventory vehicles come through, to make sure the queue maintains its throughput and stays up-to-date.

5. monitoring Mar 29, 2025, 08:48 PM UTC

   We are continuing to monitor the image queue as it catches up to real-time ingestion. Given the fact that images are hosted on third-party systems before being downloaded to Orbee's CDN, we need to pull these "politely" with proper timing between requests and have pushed the speed at which images can be processed to close to those third-party systems' limits. Therefore we expect the queue to be fully caught up in the next 24 hours. We'll provide an update tomorrow regarding the wrap-up of the image queue. Currently, images are already being processed same-day for new vehicles ingested into Orbee's Platform.

6. monitoring Mar 31, 2025, 04:32 PM UTC

   We have verified the queue has caught up yesterday, and continues to not have issues processing images. We will continue monitoring the next inventory processing cycle to confirm before closing this incident out. Images should be rendering for all vehicle content in marketing and advertising material.

7. resolved Mar 31, 2025, 09:50 PM UTC

   This incident has been resolved. Multiple inventory ingestion passes have completed without the queue falling behind or raising errors anymore.

Read the full incident report →

Started Mar 06, 2025, 07:19 PM UTC· resolved Mar 07, 2025, 08:37 PM UTC

1. monitoring Mar 06, 2025, 07:19 PM UTC

   We are aware that our Email Service Provider (ESP) may be experiencing intermittent issues. Although we are not seeing any direct problems on our end at this time, we are taking a proactive approach and closely monitoring the situation. We understand the importance of reliable email delivery and will provide immediate updates if we detect any impact on our services.

2. monitoring Mar 07, 2025, 08:35 PM UTC

   We are continuing to monitor for any further issues.

3. resolved Mar 07, 2025, 08:37 PM UTC

   Our team has confirmed that the recent service issues have been resolved. All services are now operating as expected.

Read the full incident report →

Started Feb 13, 2025, 05:35 PM UTC· resolved Feb 13, 2025, 05:35 PM UTC

1. resolved Feb 13, 2025, 05:35 PM UTC

   The temporary outage affecting our email marketing services has been resolved. The server issue that caused the disruption has been addressed, and all email marketing pages should now be functioning normally. During the outage, you may have experienced issues accessing or using the email marketing pages. We apologize for any inconvenience this may have caused. Thank you for your patience.

Read the full incident report →

Started Dec 31, 2024, 02:58 PM UTC· resolved Jan 15, 2025, 09:38 PM UTC

1. investigating Dec 31, 2024, 02:58 PM UTC

   We are investigating an issue impacting our automated email service. We are actively working to identify and resolve the issue. Our initial investigation indicates that this may result in a lower volume of emails going out until the issue fix goes in place. Once the issue is resolved, we expect automated emails to send as expected. The following services may be impacted: Automated Email Marketing We will continue to provide updates on this page as more information becomes available.

2. monitoring Jan 08, 2025, 05:57 PM UTC

   A fix has been implemented and we are monitoring the performance.

3. resolved Jan 15, 2025, 09:38 PM UTC

   We are pleased to report that the issue impacting our automated email service has been resolved. The fix has been successfully implemented and automated emails are sending as expected.

Read the full incident report →

Started Nov 27, 2024, 03:33 PM UTC· resolved Dec 03, 2024, 10:37 PM UTC

1. investigating Nov 27, 2024, 03:33 PM UTC

   We are currently investigating degraded performance of the Reporting Data Pipeline. This will lead to dashboards for website analytics to lag before showing accurate traffic counts. The pipeline is currently about 12-hours behind and is catching up. We will share more information as soon as we've identified the cause of the degregation.

2. monitoring Dec 03, 2024, 04:33 PM UTC

   We have identified a fix and applied it to the pipeline, increasing performance when dealing with inserting data. We will continue to monitor the performance today, but all data should already be up-to-date and caught up due to this degraded performance window.

3. resolved Dec 03, 2024, 10:37 PM UTC

   This incident has been resolved, and the fixes applied have continued to keep our reporting/analytics pipeline processing times consistent.

Read the full incident report →