CodeTwo experienced a minor incident on September 14, 2020 affecting Mail flow and Signature adding (rules processing) and 1 more component, lasting 4h 17m. The incident has been resolved; the full update timeline is below.
Affected components
Update timeline
- investigating Sep 14, 2020, 02:16 PM UTC
A subset of users may experience email processing delays due to Azure availability issues in the region. We're currently investigating this issue.
- investigating Sep 14, 2020, 02:23 PM UTC
We are continuing to investigate this issue.
- identified Sep 14, 2020, 02:43 PM UTC
Microsoft has confirmed performance issues of Microsoft Azure services in UK South. In the meantime, we have enabled secondary services in a different region to process the delayed messages. These messages are now queued and will soon be delivered.
- identified Sep 14, 2020, 03:03 PM UTC
While the emails are being processed via secondary services, we are actively monitoring the situation in UK South. For more info, see: https://status.azure.com/en-us/status
- monitoring Sep 14, 2020, 05:12 PM UTC
Microsoft reported that the issue was caused by a cooling failure. As a result, Azure Storage, Networking and Compute resources were shut down as part of an automated processes to preserve the equipment and prevent damage. Currently the Microsoft engineering team is focused on bringing the networking devices back online, whereas CodeTwo DevOps Teams are actively monitoring this process.
- resolved Sep 14, 2020, 06:33 PM UTC
All CodeTwo services are operational, but we are actively monitoring this geo as Microsoft has not resolved their cooling failure yet.