CodeTwo incident

[Australia East] Email processing delays

Minor Resolved View vendor source →

CodeTwo experienced a minor incident on November 19, 2019 affecting Mail flow, lasting 9h 19m. The incident has been resolved; the full update timeline is below.

Started
Nov 19, 2019, 02:56 AM UTC
Resolved
Nov 19, 2019, 12:15 PM UTC
Duration
9h 19m
Detected by Pingoru
Nov 19, 2019, 02:56 AM UTC

Affected components

Mail flow

Update timeline

  1. investigating Nov 19, 2019, 02:56 AM UTC

    A subset of users may experience delays in email delivery due to degraded performance of Microsoft Exchange Online Protection. We're actively investigating the problem now.

  2. investigating Nov 19, 2019, 03:08 AM UTC

    We are continuing to investigate this issue.

  3. investigating Nov 19, 2019, 04:05 AM UTC

    We are continuing to investigate the issue causing email delivery delays for a subset of users in Australia. The delays are most likely caused by a limited number of Microsoft Exchange Online Protection servers. We are actively working with Microsoft on resolving the problem.

  4. identified Nov 19, 2019, 05:07 AM UTC

    Microsoft engineers confirmed the problem with email delivery is on their end. Details of the incident may be found in SI# EX196121 on the Microsoft 365 Admin Dashboard. Please open the Dashboard for your Office 365 tenant for more information and updates.

  5. identified Nov 19, 2019, 06:18 AM UTC

    The performance of affected Microsoft EOP servers is now improving. Microsoft is working on the problem. Details of the incident may be found in SI# EX196121 on the Microsoft 365 Admin Dashboard and on Twitter: https://twitter.com/MSFT365Status/status/1196652517636993025.

  6. resolved Nov 19, 2019, 12:15 PM UTC

    The incident affecting Exchange Online Protection servers in Australia has now been resolved by Microsoft. All emails are now delivered without delays. If you need more information (or an RCA) why your tenant was affected, please log a service request with Microsoft and provide the following service request ID as a reference: EX196121. Thank you.