Mesh Security experienced a notice incident on October 23, 2024 affecting Inbound Email Security, lasting 5h 47m. The incident has been resolved; the full update timeline is below.
Affected components
Update timeline
- investigating Oct 23, 2024, 02:42 PM UTC
We are investigating reports of emails being deferred inbound on our US service
- identified Oct 23, 2024, 03:28 PM UTC
We have identified the issue. Microsoft is rate limiting our delivery of emails inbound on our US infrastructure. Our engineers are working on a fix. Any deferred emails will be delivered once the issue is fixed.
- identified Oct 23, 2024, 04:27 PM UTC
Our engineering team have added additional delivery ranges to mitigate the issue. Some emails are being delivered while others are being deferred. Any deferred emails will be delivered once a fix has been implemented. We are working with Microsoft on this. We will provide a further update in due course. Thank you for your patience.
- identified Oct 23, 2024, 05:15 PM UTC
We have deployed our failover delivery range which has seen an improvement, but Microsoft are still rate limiting delivery. We are continuing to work with them to fix the issue.
- identified Oct 23, 2024, 06:26 PM UTC
While our team are continuing to rotate our delivery ranges to ensure the maximum volume of email can be delivered, Microsoft continue to rate limit email delivery from our ranges. We are continuing to work with their support teams to fix this. Thank you again for your patience.
- monitoring Oct 23, 2024, 07:04 PM UTC
A fix has now been implemented. Microsoft has stopped rate limiting our delivery ranges. It will take a little bit of time for the queues to clear. We will post another update shortly.
- resolved Oct 23, 2024, 08:30 PM UTC
All queues have now cleared. We will continue to monitor. Thank you for your patience.