INKY Outage History

Inky Engineers have restored normal mail processing times in the EU region and are monitoring to ensure stability.

Around 12:50 AM EST, INKY's outbound servers in one region experienced errors that made it impossible for them to accept outbound mail. During this time any attempts to hit this set of servers would result in a deferral where the sending server would be asked to try again. The retry would hit servers that were not experiencing issues, and the email would be processed normally but with a delay of a few minutes - dependent on how often the sending server was retrying. At ~7:40 AM EST, more servers hit these same errors reducing the number of servers able to accept the outbound mail to a much smaller number resulting in the possibility of outbound delays at this time going up until the issue was resolved across all servers at 8:20 AM EST. During this time, we also uncovered an issue with the alerting tied to this particular error with the outbound servers that was remedied as well. We are still actively monitoring this issue to ensure everything is running as expected.

The initial fix we put in place did not remedy the issue and it is possible that some mail delays could still occur. Our engineers are working diligently to address the issue. We will continue to update as necessary.

Inky is continuing to monitor for any further signs of Microsoft connection difficulties. We are seeking a response from Microsoft on the cause of the issues that appear to have been isolated to either a single Microsoft region or server.

Inky engineers are monitoring to see if there is any further indication of deferrals being received from by customers from Microsoft. Inky engineers did not identify any issues with connectivity between Inky and Microsoft but have noted that traffic from Microsoft dropped between 23:30 UT and 00:15 UT. Normal traffic resumed from Microsoft after that time. Throughout that timeframe Inky was able to establish connections to and send traffic to Microsoft as normal. Inky engineers are continuing to monitor.

Fixed the issue with the update and we are seeing expected levels of detection for the Graymail category once again. We will continue to monitor and ensure it stays within expected norms.