Is Sekoia FRA1 down?

An ongoing incident is currently impacting event indexing and searches for some customers. Engineers are investigating on the issue.

An ongoing incident in the FRA1 region is impacting event indexing and search capabilities for some customers. The event storage is experiencing some failures which causes unstabilities, this results in delayed ingestion and unavailable searches. Engineers are investigating and working on mitigations to restore indexing and search functionality.

The underlying infrastructure have been stabilized and indexing has resumed, we're currently catching event indexing lag.

This incident has been resolved. All events are being indexed in real time and available for searches.

An ongoing incident is impacting detection services due to a failure in cache instances. Engineers are performing restarts and recovery steps; service restoration is in progress but may take some time.

Detection workflows were unavailable due to a cluster of cache instances becoming unresponsive after a deployment. The workflows have been restarted and all services are back online; event processing may be delayed but recovery and catch-up are in progress.

Backlog has been processed since 18:40 CEST and systems are stable. Thank you for your patience

We are currently facing an issue on our event storage impacting only some customers, impacting indexation and researches. Our engineering team is actively working on diagnosing the root cause and finding a solution. Thank you for you patience.

The root cause has been identified, and our team is currently applying patches. Event indexing was delayed for the impacted communities, which means some events may appear late on event pages. Indexing is now running and processing the backlog. Search is available again. We will keep you updated.

The patches have been applied by our engineering team, and the situation is stable again. Accumulated logs are being processed. We will keep you updated once indexing is back to real time. Thank you for your patience.

Indexing is in real-time for all communities since 23:15 CEST. Everything is stable. Thank you for your patience throughout this incident.

An ongoing incident is affecting automation features: playbook actions are not being triggered. Customers may experience failures of automated workflows. Engineering teams are investigating and working on a fix.

Engineers identified and isolated the offending playbook and restored real-time processing. A backlog playbook tasks remains and customers may see delayed automated workflows while the backlog is processed. Teams continue to work on completing the backlog.

Teams continue to work on completing the backlog

All the backlog has been processed Thanks for you patience

We are currently experiencing a major incident affecting the automation features in the FRA1 cloud region. An excessive number of automation playbook runs are being triggered overwhelming the system and causing no new playbook runs to be processed. We are investigating the issue.

The major incident affecting automation features in the FRA1 cloud region is currently under recovery. The automation feature for playbooks runs was stopped to mitigate the issue and is now being restarted gradually. Customers may still experience delays in playbook runs, but recovery is in progress.

The automation feature has been fully restored, with real-time processing resumed. We are currently handling the backlog of tasks which couldn't be handled in time.

The backlog of tasks has been processed and the automation feature is fully restored.