Panther Labs experienced a major incident on November 29, 2023 affecting Investigation, Data Retention, and Search (Data Lake), lasting 4h 50m. The incident has been resolved; the full update timeline is below.
Affected components
Update timeline
- investigating Nov 29, 2023, 08:40 PM UTC
Panther has identified an issue that may impact search, data-explorer, and scheduled queries. Customers could encounter intermittent errors when using any of these components. We are actively investigating. We will update this incident as our investigation and remediation process continues.
- identified Nov 29, 2023, 10:14 PM UTC
We have identified a potential root cause of the issue as a change affecting version 1.91 of Panther. We are going to be reverting the change and will monitor to see if the issue has been resolved. We will continue to update you as we confirm the validity of the fix.
- resolved Nov 30, 2023, 01:30 AM UTC
Our team has successfully implemented a patch to address the issue impacting search, the data explorer, and scheduled queries. Our monitoring has confirmed that the patch has been successful, but we will continue to check to ensure there are no further issues.