PerceptionPoint incident
Emails are delayed in our US environment
PerceptionPoint experienced a critical incident on December 7, 2021 affecting Email Scanning, lasting 8h 16m. The incident has been resolved; the full update timeline is below.
Affected components
Update timeline
- investigating Dec 07, 2021, 04:29 PM UTC
We are currently investigating an issue of delayed emails
- investigating Dec 07, 2021, 04:48 PM UTC
Amazon AWS experiences issues in the US region that are affecting our environment. The network issue was identified and they are working towards recovery
- investigating Dec 07, 2021, 05:36 PM UTC
We are continuing to investigate the issue while AWS service in the US has degraded service
- investigating Dec 07, 2021, 05:36 PM UTC
We are continuing to investigate this issue.
- investigating Dec 07, 2021, 06:20 PM UTC
While working with Amazon on recovering from the issue we recommend our customers switch off the routing rule if they are on M365 or Google Workspace
- monitoring Dec 07, 2021, 10:08 PM UTC
We are monitoring the traffic. We will notify when AWS recovers and when it's safe to turn the rules back on
- monitoring Dec 07, 2021, 10:37 PM UTC
The AWS services are not yet fully recovered recovering but we are able to process more email traffic. Our customers should expect to receive delayed emails shortly. We will update when it is safe to redirect emails again
- monitoring Dec 07, 2021, 11:29 PM UTC
Email traffic is now recovered. We are still monitoring the system and we will wait with resolving the case once Amazon is resolving the case on their side. It is now safe to turn the routing back to Perception Point. Please contact our support if you need any assistance with turning the rules back on
- resolved Dec 08, 2021, 12:46 AM UTC
The incident in AWS is now resolved. Our system was operational in the last three hours and emails are scanned successfully