Orbee incident
Email Marketing Campaigns stuck in "scheduling" status
Orbee experienced a critical incident on February 8, 2022 affecting Email Marketing, lasting 2h 39m. The incident has been resolved; the full update timeline is below.
Affected components
Update timeline
- identified Feb 08, 2022, 06:18 PM UTC
We have identified an issue with scheduling and sending email marketing campaigns having to do with triggering the actual status changes, and therefore the sending of email campaigns. A fix is being put together to mitigate this issue.
- identified Feb 08, 2022, 06:55 PM UTC
We are continuing to work on deploying a fix and are planning to provide an update in the next 30 minutes.
- monitoring Feb 08, 2022, 07:26 PM UTC
We have deployed a new fix that has been shown to transition scheduling/sent statuses again. We are closely monitoring deployments to verify the emails do send as intended.
- monitoring Feb 08, 2022, 07:52 PM UTC
We are continuing to monitor email campaign deployments, but all pending deployments have successfully been scheduled. We will continue to monitor additional deployments to verify everything is back to normal.
- resolved Feb 08, 2022, 08:57 PM UTC
Due to a new Email Marketing Deployment update deployed at 2022-02-08 01:00 UTC, there were issues with Email Campaigns that were currently in progress when this update went live. This was due to a new configuration change deployed with the update. The issue was patched at 2022-02-08 19:26 UTC and all pending deployments were completed. All new Email Campaigns are also deploying as intended.