Panther Labs experienced a notice incident on August 26, 2022 affecting Investigation, Data Retention, and Search (Data Lake), lasting 2d 17h. The incident has been resolved; the full update timeline is below.
Affected components
Update timeline
- investigating Aug 26, 2022, 09:59 PM UTC
Panther is investigating an issue that is causing intermittent timeouts for scheduled queries for some customers who leverage SSO to log in to Panther. This issue began affecting customers as early as August 23, 2022. We will update this incident as our investigation and remediation process continues.
- identified Aug 26, 2022, 10:47 PM UTC
We have identified the root cause of the issue impacting scheduled queries for some customers who use SSO to log in to Panther. We are now working on a patch to deploy to customer accounts. We will update this incident again after the fix has been deployed to customer accounts.
- monitoring Aug 27, 2022, 02:01 AM UTC
We have deployed the fix for this issue to impacted customer accounts. We will continue to monitor for any further issues over the next several days. Impacted customers may see alerts trigger in Panther from a few days ago as delayed queries are run. No data was lost as a result of this issue.
- resolved Aug 29, 2022, 03:27 PM UTC
Our monitoring indicates that no additional customers have encountered problems with scheduled queries since we deployed the fix on Friday. All Panther-managed customers have now received the patch that prevents this issue from occurring.