Runpanther incident

Tor Lookup Table Errors Feb 14 2023

Major Resolved View vendor source →

Runpanther experienced a major incident on February 14, 2023 affecting Detections (Rules and Policies), lasting 18h 35m. The incident has been resolved; the full update timeline is below.

Started
Feb 14, 2023, 09:11 PM UTC
Resolved
Feb 15, 2023, 03:46 PM UTC
Duration
18h 35m
Detected by Pingoru
Feb 14, 2023, 09:11 PM UTC

Affected components

Detections (Rules and Policies)

Update timeline

  1. identified Feb 14, 2023, 09:11 PM UTC

    Panther has identified an issue with our Tor Exit Node Lookup Table that is causing the Lookup Table to fail to update. This will prevent some users from uploading new or updated detections via panther_analysis_tool or via the Bulk Uploader in the Panther Console. We have developed a fix for this issue and are currently testing it. We will update this incident as our remediation process continues. Other components of Panther, including real-time detection and alert delivery, are functioning normally at this time.

  2. identified Feb 15, 2023, 01:41 AM UTC

    Our team has completed testing the fix for this issue. To ensure that the deployment goes smoothly and without errors, we will begin deploying the fix to customers tomorrow morning during US Eastern hours. We will provide another update when we have additional information to share.

  3. resolved Feb 15, 2023, 03:46 PM UTC

    Our team has deployed the patch containing the fix for this issue to all customer accounts. Our tests indicate that the issue has been resolved and customers are no longer affected. We will continue to monitor for any potential customer impact over the next several hours.