Panther Labs incident

July 28, 2022 AWS us-east-2 Issues

Minor Resolved View vendor source →

Panther Labs experienced a minor incident on July 28, 2022 affecting Panther Console (Web App) and Data Ingestion into Panther (Log Processing) and 1 more component, lasting 2h 16m. The incident has been resolved; the full update timeline is below.

Started
Jul 28, 2022, 06:05 PM UTC
Resolved
Jul 28, 2022, 08:22 PM UTC
Duration
2h 16m
Detected by Pingoru
Jul 28, 2022, 06:05 PM UTC

Affected components

Panther Console (Web App)Data Ingestion into Panther (Log Processing)Detections (Rules and Policies)Investigation, Data Retention, and Search (Data Lake)Alert Delivery

Update timeline

  1. identified Jul 28, 2022, 06:05 PM UTC

    Panther has confirmed an AWS outage in the us-east-2 region (https://health.aws.amazon.com/health/status) that began at 17:11 UTC. This outage is affecting multiple AWS services including Lambda and DynamoDB. Customers with Panther deployments in us-east-2 may experience page load errors and service latency while these systems recover. Other customer resources in us-east-2 may also experience issues. We will continue to update this incident as more information becomes available.

  2. monitoring Jul 28, 2022, 07:45 PM UTC

    A fix has been implemented and we are monitoring the results.

  3. resolved Jul 28, 2022, 08:22 PM UTC

    Our monitoring indicates that there is no further impact from this issue on Panther customer deployments. Additionally, AWS has updated their status page to indicate that they have made progress recovering the resources impacted by this outage. We will continue to follow this issue and provide updates if we observe additional service disruptions. We may reach out to individual customers if we identify ongoing issues as a result of this downtime.