Obsidian Security incident

Delayed alerts and activity module population

Minor Resolved View vendor source →

Obsidian Security experienced a minor incident on October 8, 2024 affecting Threat Management and Action Policies, lasting 1d 2h. The incident has been resolved; the full update timeline is below.

Started
Oct 08, 2024, 12:49 PM UTC
Resolved
Oct 09, 2024, 03:38 PM UTC
Duration
1d 2h
Detected by Pingoru
Oct 08, 2024, 12:49 PM UTC

Affected components

Threat ManagementAction Policies

Update timeline

  1. identified Oct 08, 2024, 12:49 PM UTC

    We have identified an issue that may result in delayed event population within the activity module and a delay in alerts being triggered. Our teams are currently working to mitigate the issue and any updates will be posted on this incident notification.

  2. identified Oct 08, 2024, 03:22 PM UTC

    We have identified the offending component and are continuing to work towards development of a fix to address the underlying issue. Further updates will be posted on this incident notification as we progress towards full resolution.

  3. monitoring Oct 08, 2024, 07:19 PM UTC

    A fix to address delays with event population and alerting has been deployed, and backlogged events are being processed successfully at this time. Obsidian's operations team will continue to actively monitor processing queues, and further updates will be posted to this incident notification once queues have been fully processed.

  4. resolved Oct 09, 2024, 03:38 PM UTC

    This incident has been resolved. All activity event processing and alerting queues have returned to normalized levels. If you encounter any further issues, please reach out to our support team.