AWS us-east-1 Service Outage
Affected: Panther Console (Web App)Data Ingestion into Panther (Log Processing)Detections (Rules and Policies)Investigation, Data Retention, and Search (Data Lake)Alert DeliveryEnrichment
Runpanther Outage History
Runpanther is up right nowRunpanther had 8 outages in the last 2 years totaling 62h 12m of downtime — averaging 0.3 incidents per month.
There were 8 Runpanther outages since July 31, 2024 totaling 62h 12m of downtime. Each is summarised below — incident details, duration, and resolution information.
Malformed JSON files
Affected: Data Ingestion into Panther (Log Processing)
Timeline · 4 updates
CloudTrail Classification Issues
Affected: Data Ingestion into Panther (Log Processing)
Timeline · 2 updates
- identified May 13, 2025, 08:55 PM UTC
Panther has identified an issue with the AWS.CloudTrail schema that is causing a small percentage of CloudTrail logs to raise classification errors and fail to ingest into Panther. We have identified the root cause of the issue and are in the process of deploying a fix. We will update this incident as our remediation process continues.
- resolved May 13, 2025, 10:59 PM UTC
We have reverted the changes to the AWS.CloudTrail schema that were causing classification errors. At this time, you should not see any additional errors related to this issue. If you’d like to view the classification errors in your Panther Console, in Search, select the Monitor database and Classification Failures table. If you are interested in re-ingesting the logs that failed to ingest, please reach out to the Panther support team.
Snowflake Data Cloud Incident
Affected: Data Ingestion into Panther (Log Processing)Investigation, Data Retention, and Search (Data Lake)Enrichment
Timeline · 2 updates
- monitoring Mar 19, 2025, 08:13 PM UTC
Snowflake Data Cloud is recovering from a recent incident. Customers in specific regions may experience intermittent delays or timeouts when performing queries or using Snowflake services. You may be affected if your Panther instance is in the following regions: - AWS US-East-1 (N. Virginia) - Affected Snowflake services: Snowflake Data Warehouse (Database), Snowpipe (Data Ingestion), Replication, Snowsight - Potentially affected Panther services: Data ingestion, lookup tables, scheduled queries and rules, ad-hoc queries - AWS US-West-2 (Oregon) - Affected Snowflake services: Snowflake Data Warehouse (Database), Snowsight - Potentially affected Panther services: Lookup tables, scheduled queries and rules, ad-hoc queries For real-time updates on this incident, visit: https://status.snowflake.com/. We will continue to monitor the situation and will update the status page once resolved.
- resolved Mar 19, 2025, 10:58 PM UTC
Snowflake has implemented a fix and the incident has been resolved. Your Snowflake and Panther services should now function as expected. If you experience any other issues related to this incident, please contact Panther support.
Alert Generation and Delivery Failures
Affected: Alert Delivery
Timeline · 3 updates
- identified Jan 17, 2025, 10:31 PM UTC
Panther has identified an issue impacting alert generation (and delivery) for detections with an events threshold value greater than one. We are currently testing a potential fix, and will update the status page once we confirm the solution is effective.
- monitoring Jan 18, 2025, 01:37 AM UTC
We have identified the root cause of the issue and deployed a fix. Our team is currently monitoring the situation to ensure that the issue has been fully resolved. Once confirmed, we will officially close this incident. If you’d like to determine whether this issue impacted your account, please follow the steps outlined in the article below: https://help.panther.com/articles/9727040283-how-to-determine-impact-of-the-alert-generation-and-delivery-failures-incident
- resolved Jan 18, 2025, 02:22 AM UTC
Our observations have confirmed that the fix has been successful, but we will continue to monitor to ensure there are no further issues. We sincerely apologize for the inconvenience this may have caused and appreciate your understanding as we worked to resolve the issue. If you have any questions or need further assistance, please don’t hesitate to contact our support team.
Intermittent Login Failures
Affected: Panther Console (Web App)
Timeline · 2 updates
- identified Dec 13, 2024, 03:22 AM UTC
Panther has identified an issue that prevents some customers from accessing the Panther console due to an ongoing AWS incident impacting customers in the US-EAST-1 region. At this point, logging in to the Panther console is the only service that is impacted. No other services appear to be impacted. You can also follow the ongoing incident using AWS’s status page here: https://health.aws.amazon.com/health/status
- resolved Dec 13, 2024, 12:37 PM UTC
The issue impacting access to the Panther console has been resolved following AWS’s remediation. All services are now operating normally. For more details about the AWS incident, you can visit their status page: https://health.aws.amazon.com/health/status Thank you for your patience. Please let us know if you experience any further issues.
IPinfo Data Update Issue
Affected: Enrichment
Timeline · 2 updates
- identified Sep 23, 2024, 01:42 PM UTC
We have identified an upstream issue with the IPinfo Enrichment Provider that has caused Panther to not receive new data from IPinfo since September 19, 2024. While IPinfo Lookup Tables remain functional, they currently contain data only up to September 19, 2024. If you leverage IPinfo data in your detections, this lapse could affect their accuracy. Our team is actively collaborating with IPinfo to resolve this issue as quickly as possible. We will provide updates as our investigation and remediation efforts progress. Thank you for your patience.
- resolved Sep 23, 2024, 06:27 PM UTC
We are pleased to inform you that the issue with the IPinfo Enrichment Provider has been resolved. Panther is now successfully receiving new data from IPinfo, and we have confirmed that all data is up to date beyond September 19, 2024. The IPinfo Lookup Tables should be again fully operational with the latest available data. If you have any questions or encounter any issues, please contact Panther Support directly.
AWS US-EAST-1 outage
Affected: Panther Console (Web App)Data Ingestion into Panther (Log Processing)