CodeTwo experienced a minor incident on February 3, 2021 affecting Mail flow and Mail flow, lasting 3h 19m. The incident has been resolved; the full update timeline is below.
Affected components
Update timeline
- investigating Feb 03, 2021, 09:41 PM UTC
Users in this region may experience delays in email delivery. We're actively investigating the problem now.
- investigating Feb 03, 2021, 09:48 PM UTC
We are continuing to investigate this issue.
- identified Feb 03, 2021, 09:50 PM UTC
The issue has been identified.
- identified Feb 03, 2021, 10:09 PM UTC
We are continuing to work on this. It seems to be a Microsoft performance issue. Messages processed by CodeTwo cannot be delivered back to Microsoft 365 in a timely manner. We're seeing signs of recovery though. More and more messages are being processed and the queues are getting smaller. All messages will be eventually delivered with signatures.
- identified Feb 03, 2021, 10:51 PM UTC
Microsoft reports there is a problem with Exchange Online in North America: https://twitter.com/MSFT365Status/status/1357097859535888388. The tweet reads: We’re investigating an issue with Exchange Online for some customers in North America. Additional information can be found in the admin center under EX237654.
- identified Feb 03, 2021, 11:35 PM UTC
The situation is slowly improving, although email delivery times are still far from perfect. It looks like a lot of Exchange Online Protection servers are affected which significantly slows down email processing for scores of users in North America no matter if they use 3rd party email processing services or not. We are continuing to actively monitor the situation. We have powered up multiple additional cloud instances on Azure to make sure our service is scaled up to guarantee max performance at the moment and also when Microsoft fixes the problem and releases the messages that have piled up.
- resolved Feb 04, 2021, 01:00 AM UTC
This incident has been resolved.