Panther Labs experienced a minor incident on December 7, 2021 affecting Data Ingestion into Panther (Log Processing) and Detections (Rules and Policies), lasting 1d 2h. The incident has been resolved; the full update timeline is below.
Affected components
Update timeline
- investigating Dec 07, 2021, 04:08 PM UTC
We are observing intermittent issues with underlying AWS services in the us-east-1 region. This may impact Panther's service for customers in this region, and could include delays in log processing and alerting. We will continue to monitor the situation and update this incident with new information as it becomes available.
- identified Dec 07, 2021, 05:08 PM UTC
Panther is continuing to investigate the impact of ongoing AWS us-east-1 service issues (https://status.aws.amazon.com). Note that customers without Panther accounts deployed in us-east-1 may still be affected because of integration with cloud resources in that region. We will continue to update this incident as more information becomes available.
- identified Dec 07, 2021, 09:51 PM UTC
We are continuing to monitor issues with AWS region us-east-1 that could affect Panther log processing and alerting. Customers without Panther accounts deployed in us-east-1 may still be affected because of integration with cloud resources in that region. At 12:34 PM PST, AWS updated their status page (https://status.aws.amazon.com/) and indicated that they have identified the root cause of the problem and are working to mitigate and resolve the issues. However, they do not currently have an ETA for full recovery. We will continue to update this incident as more information becomes available.
- monitoring Dec 08, 2021, 04:36 PM UTC
AWS has reported a resolution of service issues on us-east-1 and Panther is no longer detecting any customer impact. Previously affected Panther accounts should be working as expected without any customer action required. We will continue to monitor the situation to verify it is fully resolved and update this incident to confirm the incident is resolved or provide more information when possible.
- resolved Dec 08, 2021, 06:22 PM UTC
Panther has confirmed the incident caused by issues with AWS us-east-1 is fully resolved and customers are no longer affected.