Recorded Future Outage History
Recorded Future is up right nowPingoru has recorded 51 incidents for Recorded Future: 13 in the last 12 months and 4 in the last 90 days.
Show as a table
| Month | Incidents | Hours with an open incident |
|---|---|---|
| April 2026 | 0 | 0 of 720 (0%) |
| May 2026 | 1 | 8 of 744 (1%) |
| June 2026 | 0 | 0 of 720 (0%) |
| July 2026 | 2 | 7 of 744 (1%) |
| August 2026 | 2 | 4 of 744 (1%) |
| September 2026 | 1 | 0 of 720 (0%) |
| October 2026 | 0 | 0 of 515 (0%) |
Incidents, newest first
Notice September 29, 2026 Portal disruption of service 2m User Interface, API & MCP
Started Sep 29, 2026, 07:23 PM UTC· resolved Sep 29, 2026, 07:26 PM UTC
- investigating Sep 29, 2026, 07:23 PM UTC
Dear Customer, We are currently experiencing a service disruption with the Recorded Future application portal. Our Platform Operations team are actively working on restoring accessibility to an optimal level of service. We will continue to provide updates as they become available. Please contact our support team at [email protected] if you have any questions. Regards, Recorded Future Platform Operations
- resolved Sep 29, 2026, 07:26 PM UTC
Dear Customer, We are pleased to inform you that the service disruption affecting the Recorded Future application portal has been resolved. All systems are now operating normally. If you have any remaining questions or continue to experience issues, please contact our support team at [email protected]. Regards, Recorded Future Platform Operations
Major August 21, 2026 Attack Surface Intelligence disruptions 1h 12m Attack Surface Intelligence
Started Aug 21, 2026, 06:15 AM UTC· resolved Aug 21, 2026, 07:28 AM UTC
- investigating Aug 21, 2026, 06:15 AM UTC
Dear customers, We are currently investigating an issue affecting access to the Attack Surface Intelligence, which may result in errors for some users. Our team is actively working to resolve this as quickly as possible. We will post an update once normal performance is restored. In the meantime, if you have any questions or concerns, please reach out to our Support team at [email protected]. Thank you for your patience, Recorded Future Platform Operations
- resolved Aug 21, 2026, 07:28 AM UTC
Dear customers, The issue affecting access to the Attack Surface Intelligence has been resolved, and the service is now operating normally. We apologize for any inconvenience this may have caused. If you continue to experience any issues, please contact our support team at [email protected]. Thank you for your patience, Recorded Future Platform Operations
Notice August 2, 2026 Portal Disruption of Service 3h
Started Aug 02, 2026, 01:45 PM UTC· resolved Aug 02, 2026, 04:45 PM UTC
- resolved Aug 02, 2026, 05:41 PM UTC
Dear Customer, We recently experienced a service disruption regarding a series of Recorded Future Alerts. Our Platform Operations team recognized the disruption and worked quickly to resolve this incident. Between roughly 13:45-16:45 UTC on August 1st, a series of Alerts could not be generated. We are still investigating the initial cause. While services remain operational, a post-mortem will be updated once our investigation has completed. Please contact our support team at [email protected] if you have any questions. Regards, Recorded Future Platform Operations
Notice March 5, 2026 Recorded Future ASI disruption of service 2h 17m Attack Surface Intelligence
Started Mar 05, 2026, 08:30 PM UTC· resolved Mar 05, 2026, 10:47 PM UTC
- investigating Mar 05, 2026, 08:30 PM UTC
Dear Customer, We are currently experiencing a service disruption with the Recorded Future Attack Surface Intelligence. Our product operations team are actively working on restoring accessibility to an optimal level of service. We will continue to provide updates as they become available. Please contact our support team at [email protected] if you have any questions. Regards, Recorded Future Platform Operations
- investigating Mar 05, 2026, 09:58 PM UTC
We are continuing to investigate this issue.
- monitoring Mar 05, 2026, 10:10 PM UTC
The application is performing as expected. We are continuing to monitor to ensure it remains performant.
- resolved Mar 05, 2026, 10:47 PM UTC
The incident has been resolved, and Attack Surface Module has returned to normal performance.
Major February 26, 2026 Code Repository Collection Disruption 26d 6h Collection and Processing
Started Feb 26, 2026, 08:43 PM UTC· resolved Mar 25, 2026, 02:48 AM UTC
- identified Feb 26, 2026, 08:43 PM UTC
Dear Customer, Starting today, Recorded Future became aware of a disruption in some of its collection of commits to public repositories, with expected intermittent gaps to customers who rely on ingestion of the "Code Repository" source type within queries or alerts. We are actively working to resolve the collection issue, and are actively backfilling any missing data now. We expect to be fully caught up within the next few days, with relevant alerts being triggered retroactively. We will continue to provide updates as they become available, and when the backfill is fully caught up. Please contact our support team at [email protected], or your Technical Account Manager if you have any questions. Regards, Recorded Future Platform Operations
- identified Mar 03, 2026, 04:25 PM UTC
Dear Customer, We wanted to provide an update regarding the disruption and recovery to the code repository collection data. We are still actively working to resolve the collection issue, and expect to be fully caught up within the next 24 hours, with relevant alerts being triggered retroactively. We will continue to provide updates as they become available, and when the backfill is fully caught up. Please contact our support team at [email protected], or your Technical Account Manager if you have any questions. Regards, Recorded Future Platform Operations
- monitoring Mar 09, 2026, 08:18 PM UTC
Dear Customer, We wanted to provide an update as to the disruption and recovery to the code repository collection data, as we are still actively working to resolve the collection issue. While conditions have improved dramatically, we are still in a degraded performance state with data coming in slightly delayed. We will continue to provide updates as they become available, and when the backfill is fully caught up. Please contact our support team at [email protected], or your Technical Account Manager if you have any questions. Regards, Recorded Future Platform Operations
- resolved Mar 25, 2026, 02:48 AM UTC
Dear Customer, Collection and processing of content is now near current, and systems that process new content within Recorded Future are returning to normal operations. We apologize for the delays experienced earlier today. Please contact our support team at [email protected] if you have any questions. Regards, Recorded Future Platform Operations
Major January 21, 2026 SendGrid Email Alert Delivery Disruption 2h 14m Alerts
Started Jan 21, 2026, 08:55 AM UTC· resolved Jan 21, 2026, 11:10 AM UTC
- identified Jan 21, 2026, 08:55 AM UTC
Dear Customer, We are currently addressing a service disruption with our email delivery provider, SendGrid, which may result in delayed or intermittent delivery of automated email alerts. Our engineering team is working urgently with the provider to restore full functionality. Please note that all alerts remain fully accessible via the Recorded Future Portal. This disruption is limited to email delivery only; your real-time data and monitoring within the platform are unaffected. We will notify you as soon as email services are fully restored. Please contact our support team at [email protected] if you have any questions. Thank you for your patience. Regards, Recorded Future Platform Operations
- resolved Jan 21, 2026, 11:10 AM UTC
This incident has been resolved.
- postmortem Jan 23, 2026, 07:54 PM UTC
* **Issue:** * Between 08:55 and 11:10 UTC on January 21, 2026, the Recorded Future portal experienced a service disruption affecting outbound email delivery. * **Cause:** * Our outbound mail partner temporarily disabled mail sending from our domain which was promptly resolved. * **Remediation / Path Forward:** * We have worked extensively with our mail partner to ensure that such disabling actions are not taken in the future and we are also investigating adding backup email sending partners to provide additional resilience.
Critical November 12, 2025 Recorded Future AI Disruption of Service 2h 34m Recorded Future AI
Started Nov 12, 2025, 01:01 AM UTC· resolved Nov 12, 2025, 03:36 AM UTC
- investigating Nov 12, 2025, 01:01 AM UTC
Dear Customer, We are currently experiencing a service disruption with the Recorded Future AI. Our product operations team are actively working on restoring accessibility to an optimal level of service. We will continue to provide updates as they become available. Please contact our support team at [email protected] if you have any questions. Regards, Recorded Future Platform Operations
- monitoring Nov 12, 2025, 01:53 AM UTC
A fix has been implemented and we are monitoring the results.
- monitoring Nov 12, 2025, 01:53 AM UTC
We are continuing to monitor for any further issues.
- resolved Nov 12, 2025, 03:36 AM UTC
This incident has been resolved.
- postmortem Nov 28, 2025, 07:37 PM UTC
* **Issue:** * Between 20:25 UTC on November 11, 2025 and 01:53 UTC on November 12, 2025, Recorded Future’s AI service experienced slow performance and intermittent outages, affecting the timely delivery and processing of intelligence reports. * **Cause:** * The disruption was caused by a system configuration which did not allow sufficient automatic scaling. * **Remediation / Path Forward:** * Immediate action was taken to update this configuration and we are implementing a comprehensive plan for long-term resilience.
Notice October 26, 2025 Delay in content processing 12m
Started Oct 26, 2025, 09:56 PM UTC· resolved Oct 26, 2025, 10:08 PM UTC
- resolved Nov 12, 2025, 02:03 AM UTC
Dear Customer, Collection and analysis of content is now current and systems that process new content in Recorded Future are operating normally. We apologize for the delays earlier. Please contact our support team at [email protected] if you have any questions. Regards, Recorded Future Platform Operations
- postmortem Nov 12, 2025, 02:04 AM UTC
**Issue:** * Between 21:56 and 22:08 UTC on October 27, 2025, Recorded Future's data processing system experienced a maximum delay of 72 minutes. This delay directly impacted the timeliness of data availability for users. **Cause:** * The root cause of the data processing delay was a loss of synchronization within the message queue cluster, triggered by a network interruption. The unsynchronized state led the message queue cluster to become unresponsive, halting the normal processing of data, resulting in the eventual 72-minute data delay. **Remediation / Path Forward:** * Manually restored cluster integrity. This action successfully restored the cluster integrity and brought the data processing back online.
Notice October 20, 2025 Delay in content processing and alerting. 59m Alerts, API & MCP, Collection and Processing
Started Oct 20, 2025, 07:20 PM UTC· resolved Oct 20, 2025, 08:19 PM UTC
- investigating Oct 20, 2025, 07:20 PM UTC
Dear Customer, We are currently experiencing a delay in our content collection and analysis processes exceeding 1 hour in duration as a result of a service disruption with our hosting provider, AWS. This means that there is a delay between when content is published and when it is available in Recorded Future’s web application, API, and alerts. Other systems are running normally, historical data is still available, and we do not anticipate any data loss from this issue. We know the root cause, and are working to mitigate the issue, but do not have an estimate for resolution at this time. We will follow up when the system is back to normal, but please contact our support team at [email protected] if you have any questions or concerns. Regards, Recorded Future Platform Operations
- identified Oct 20, 2025, 07:42 PM UTC
Our team has mitigated the issue, and the processing delay is reducing. We will provide an updated estimated resolution time once we are able to confirm the speed of the reduction.
- resolved Oct 20, 2025, 08:19 PM UTC
Dear Customer, We are now seeing the analysis processing returning to normal timeframes. While delays may still be present, delay times are within expected ranges. Regards, Recorded Future Platform Operations
- postmortem Nov 03, 2025, 07:33 PM UTC
* **Issue:** * On the day of the major [Amazon Web Services \(AWS\) outage](https://aws.amazon.com/message/101925/), our systems experienced a significant delay in data processing. Specifically, at 19:20, a normal surge in data arrived for processing by Recorded Future. However, due to the ongoing AWS outage, neither automatic nor manual scaling of our processing capacity was technically possible. This lack of available compute resources caused the data processing queues to suffer unexpected delays. * **Cause:** * The primary cause was the [AWS regional issue in US-EAST-1](https://aws.amazon.com/message/101925/), which directly inhibited the ability of our Platform to dynamically increase resource capacity \(scaling\) to meet the incoming data load. * **Remediation / Path Forward:** * Once AWS resolved the underlying issue that was preventing scaling, our systems automatically increased capacity and processed the queued data as designed, bringing the queues back to normal levels. * Recorded Future is actively discussing a strategic initiative to migrate our systems to alternative regions toenhance our resilience against future single-region AWS outages.
Critical August 6, 2025 Degraded Performance - Course Platform Availability 2h 49m Recorded Future University
Started Aug 06, 2025, 02:55 PM UTC· resolved Aug 06, 2025, 05:44 PM UTC
- investigating Aug 06, 2025, 02:55 PM UTC
We are currently investigating this issue.
- identified Aug 06, 2025, 03:52 PM UTC
The issue has been identified and a fix is being implemented.
- identified Aug 06, 2025, 04:45 PM UTC
Dear Customer, We are currently experiencing a service disruption pertaining to the Recorded Future University training platform, which may result in errors trying to log in to https://university.recordedfuture.com/ . We are currently working with our vendor to resolve this problem as soon as possible. Please note that access to the Recorded Future application platform (https://recordedfuture.com/live) is unaffected, and our support site (https://support.recordedfuture.com/hc/en-us) is still available for additional training content. We will follow up when the system performance returns to normal, but please contact our support team at [email protected] if you have any questions or concerns. Regards, Recorded Future Platform Operations
- resolved Aug 06, 2025, 05:44 PM UTC
Dear Customer, Access to the Recorded Future University training platform is now restored, and the incident is now considered resolved. Please contact our support team at [email protected] if you have any questions or concerns. Regards, Recorded Future Platform Operations
Critical July 15, 2025 Recorded Future Sandbox Service Disruption 14m Sandbox
Started Jul 15, 2025, 06:48 AM UTC· resolved Jul 15, 2025, 07:02 AM UTC
- investigating Jul 15, 2025, 06:48 AM UTC
Dear Customer, We are currently experiencing a service disruption to our Sandbox feature, with access currently unavailable on sandbox.recordedfuture.com and private.tria.ge . We're currently reviewing the incident with high urgency, and will continue to provide updates as they become available. Please contact our support team at [email protected] if you have any questions. Regards, Recorded Future Platform Operations
- investigating Jul 15, 2025, 07:02 AM UTC
Dear Recorded Future Customers, We want to inform you that the Sandbox service disruption and degraded performance have now been resolved. System performance and response times are back to normal. Please contact our support team at [email protected] if you have any questions or concerns. Regards, Recorded Future Platform Operations
- resolved Jul 15, 2025, 07:02 AM UTC
This incident has been resolved.
- postmortem Jul 23, 2025, 08:56 PM UTC
* **Issue:** * At approximately 6:25 UTC on July 15th, we received several reports that the Recorded Future Sandbox \(specifically [sandbox.recordedfuture.com](http://sandbox.recordedfuture.com)\), was unavailable, which was confirmed by our operations team. * **Cause:** * The root cause of the incident was a configuration error. * **Remediation / Path Forward:** * At approximately 6:48 UTC, a formal incident was opened for client communications, with the root cause being identified shortly thereafter. The correct Sandbox configurations were applied, with the incident being marked as resolved at approximately 7:02 UTC. As a path forward, new monitoring checks were added to alert for any future configuration discrepancies.
Major June 26, 2025 Performance issues with our Browser Extension 1h 57m Browser Extension
Started Jun 26, 2025, 11:38 AM UTC· resolved Jun 26, 2025, 01:35 PM UTC
- investigating Jun 26, 2025, 11:38 AM UTC
Dear Customer, We are experiencing performance issues with our Browser Extension and our engineers are currently working to resolve this problem as quickly as possible. Please contact our support team at [email protected] if you have any questions or concerns. Regards, Recorded Future Platform Operations
- resolved Jun 26, 2025, 01:35 PM UTC
Dear Customer, The performance issues with our Browser Extension have been resolved. Please contact our support team at [email protected] if you have any questions or concerns. Regards, Recorded Future Platform Operations
Minor June 23, 2025 Degradation in Service for Advanced Query Builder and Viewing Alerts 3h 30m User Interface, API & MCP
Started Jun 23, 2025, 11:36 PM UTC· resolved Jun 24, 2025, 03:06 AM UTC
- investigating Jun 23, 2025, 11:36 PM UTC
Dear Recorded Future Customers, We want to inform you that our Advanced Query Builder and viewing alerts in the Alerts Dashboard are both currently experiencing degraded performance. Our team is actively investigating the issue and working to restore full functionality as quickly as possible. We apologize for any inconvenience this may cause and appreciate your patience. We will continue to provide updates as more information becomes available.
- monitoring Jun 24, 2025, 02:40 AM UTC
A fix has been implemented and we are monitoring the results.
- resolved Jun 24, 2025, 03:06 AM UTC
Dear Recorded Future Customers, We want to inform you that our Advanced Query Builder and viewing alerts in the Alerts Dashboard degraded performance have been resolved. System performance and response times are back to normal. Please contact our support team at [email protected] if you have any questions or concerns. Regards, Recorded Future Platform Operations
Minor April 23, 2025 SendGrid Email Delivery Outage 2h 28m Collection and Processing
Started Apr 23, 2025, 10:33 PM UTC· resolved Apr 24, 2025, 01:01 AM UTC
- investigating Apr 23, 2025, 10:33 PM UTC
We want to let you know that we are currently experiencing an issue with our alert-email delivery system, SendGrid. As a result, some automated alert messages may be impacted or delayed. Our engineering team is actively working with SendGrid to restore full delivery. We will update you as soon as email alerts are operational again. Thank you.
- investigating Apr 24, 2025, 12:59 AM UTC
The SendGrid email delivery issue has been fully resolved. All emails are now sending and new messages are being delivered normally.
- resolved Apr 24, 2025, 01:01 AM UTC
Dear Customer, Collection and analysis of content is now current and systems that process new content in Recorded Future are operating normally. We apologize for the delays earlier today. Please contact our support team at [email protected] if you have any questions. Regards, Recorded Future Platform Operations
Critical April 15, 2025 Recorded Future Portal and API Disruption 38m User Interface, API & MCP
Started Apr 15, 2025, 03:10 PM UTC· resolved Apr 15, 2025, 03:48 PM UTC
- investigating Apr 15, 2025, 03:10 PM UTC
Dear Customer, We are currently experiencing a service disruption with the Recorded Future application portal and API. Our product operations team are actively working on restoring accessibility to an optimal level of service. We will continue to provide updates as they become available. Please contact our support team at [email protected] if you have any questions. Regards, Recorded Future Platform Operations
- investigating Apr 15, 2025, 03:24 PM UTC
We are continuing to investigate this issue.
- resolved Apr 15, 2025, 03:48 PM UTC
Dear Customer, We can now consider the service disruption with our portal and API to be resolved, and a root cause analysis will be produced for this incident. Please contact our support team at [email protected], or your Intelligence Services resource if you have any questions. Regards, Recorded Future Platform Operations
- postmortem Apr 26, 2025, 07:17 PM UTC
Dear Customer, Below is our post mortem to the incident in question from April 15, 2025: * **Issue:** * At approximately 14:52 UTC on April 15th, monitoring alerts indicated that both the Portal and API were unresponsive to customers. Following initial investigations, the incident status was escalated to a “Major Outage” for the “Portal” and “API” components on [status.recordedfuture.com](http://status.recordedfuture.com) at around 15:10 UTC. * **Cause:** * The incident was traced to the main authorization service, which is a critical dependency for backend request handling. One instance within the service group entered an unresponsive state but continued to accept and process threads. This led to a situation where most incoming authentication requests to this service appeared to hang. As a result, dependent services—including the Portal and API—were perceived as unresponsive from the end-user perspective for a short period of time. * **Remediation / Path Forward:** * Corrections were made to rebalance traffic and service requests to restore normal service, and the issue was declared fully resolved at approximately 15:13 UTC. * To prevent the recurrence of this issue, the following steps are being undertaken: * Enhancing the authorization service to detect and isolate non-responsive instances automatically. * Introducing safeguards to prevent thread buildup when an instance becomes unresponsive.
Notice February 7, 2025 Access Recorded Future impared 46m User Interface, Alerts, API & MCP, Mobile application
Started Feb 07, 2025, 12:53 PM UTC· resolved Feb 07, 2025, 01:39 PM UTC
- investigating Feb 07, 2025, 12:53 PM UTC
Access to the Recorded Future application and API is currently impaired, and we are currently investigating.
- investigating Feb 07, 2025, 01:04 PM UTC
Dear Client, We are currently experiencing a service disruption which affects the Recorded Future application Portal, API, alerting, and the mobile application. Our product operations team are actively working on identifying the issue and restoring accessibility to an optimal level of service We will continue to provide updates as they become available. Please contact our support team at [email protected] if you have any questions. Regards, Recorded Future Platform Operations
- resolved Feb 07, 2025, 01:39 PM UTC
Dear Client, The Recorded Future application Portal, API, alerting, and mobile application services have now been restored. Our teams are actively working to monitor the performance of the platform, and a Root Cause Analysis (RCA) will be posted here once complete. Regards, Recorded Future Platform Operations
- postmortem Feb 17, 2025, 01:38 AM UTC
* **Issue:** * Routine database maintenance led to unexpected performance degradation * **Cause:** * A new node was added to the database cluster used for verification of application logins. The process of adding the node used was the same documented process followed for adding nodes to all other database clusters, which is routinely performed \(several times per week\). * It appears that we encountered a rare bug with the database cluster software which caused the new node to be treated as a primary node even though it was added as a backup node, which caused massive latency for the cluster, even blocking reconfiguration commands. * **Remediation / Path Forward:** * We have updated our node addition process to include even more safety measures in order to reduce the risk of similar future occurrences. * We have contacted the database cluster software vendor to notify them of this bug.
Notice January 27, 2025 Delayed Alert Delivery 12h 22m Alerts
Started Jan 27, 2025, 02:12 AM UTC· resolved Jan 27, 2025, 02:35 PM UTC
- identified Jan 27, 2025, 02:12 AM UTC
Dear Customer, A subset of our alerts are experiencing a delivery delay. This affects both email alerts and in-app notifications. The affected alerts are currently delayed by up to 2 hours, and the backlog is already decreasing based on our response. Please note that other systems including Recorded Future's web portal, API, collection, and analysis are unaffected. We will follow up when alert delivery returns to normal. Please contact our support team at [email protected] if you have any questions or concerns. Regards, Recorded Future Platform Operations
- resolved Jan 27, 2025, 02:35 PM UTC
Dear Customer, The issue affecting our alert delivery has been resolved, and the domain abuse screenshots have now resumed normal processing. Please contact our support team at [email protected] if you have any questions or concerns.
- postmortem Feb 16, 2025, 07:15 PM UTC
**Issue:** On January 26, 2025 at approximately 9:26 PM EST, our monitoring system had alerted our operations team to a service failure that impacted the system which feeds our alert delivery system. As a result of this incident, Brand Intelligence clients saw delays in delivery of Domain Abuse alerts, including screenshots taken pertaining to the alert. **Cause:** The failure was triggered by an unusually high volume of domain abuse reports, which amounted to over 40x the normal load, for 5 consecutive hours. **Resolution:** To manage that level of increased volume and ensure all information was processed, our operations team engineered the system to slow down the handling of alerts to ensure all messages were processed and alerts sent. After a few hours the system returned to normal, but we formally closed the incident on January 27th, at approximately 9:35 am EST. **Path Forward:** As a result of this incident, we are actively reviewing the autoscaling capacities of our alerting system to better support future spikes of domain abuse reports .
Critical January 20, 2025 Recorded Future Portal Disruption 56m User Interface
Started Jan 20, 2025, 02:45 AM UTC· resolved Jan 20, 2025, 03:41 AM UTC
- investigating Jan 20, 2025, 02:45 AM UTC
Dear Customer, We are currently experiencing a service disruption with the Recorded Future application portal. Our product operations team are actively working on restoring accessibility to an optimal level of service We will continue to provide updates as they become available. Please contact our support team at [email protected] if you have any questions. Regards, Recorded Future Platform Operations
- resolved Jan 20, 2025, 03:41 AM UTC
Dear Customer, We've confirmed that the incident that was affecting access to our Recorded Future application portal has now been resolved and should be operating normally again. We will resolve this incident, however, feel free to contact our Support team at [email protected] if you have any questions or concerns. Regards, Recorded Future Platform Operations
- postmortem Jan 30, 2025, 04:50 AM UTC
* **Issue**: * On January 19, 2025, at 1:04 UTC, a subset of users reported being unable to log into the Recorded Future platform.. * **Cause**: * A cluster of proxy servers responsible for authentication failed to recognize a new SSL certificate that had been deployed earlier. * **Remediation/Resolution:** * The Recorded Future Operations team identified and isolated the problematic proxy servers and reconfigured them to recognize the new SSL certificate which restored full functionality for all users. * **Path Forward:** * To prevent similar incidents in the future, internal documentation and processes have been updated to include specific steps and tests for ensuring proxy servers correctly recognize new SSL certificates immediately after deployment to avoid disruptions in the future.
Minor November 5, 2024 API and Portal Disruption of Service 2h 54m User Interface, API & MCP
Started Nov 05, 2024, 01:34 PM UTC· resolved Nov 05, 2024, 04:28 PM UTC
- investigating Nov 05, 2024, 01:34 PM UTC
Dear Client, We are currently experiencing degradation of system performance which is impacting accessibility to our playbook alert API, in addition to portal accessibility to such features as alerts and lists. Our product operations team are actively working on restoring accessibility to an optimal level of service We will continue to provide updates as they become available. Please contact our support team at [email protected], or your Intelligence Services representative if you have any questions. Regards, Recorded Future Platform Operations
- monitoring Nov 05, 2024, 02:41 PM UTC
Dear Client, We have identified the root of instability and believe we have restored performance back to optimal levels. We will continue to monitor to ensure services remain fully available, and provide an update when the incident is fully resolved. Please contact our support team at [email protected], or your Intelligence Services representative if you have any questions. Regards, Recorded Future Platform Operations
- resolved Nov 05, 2024, 04:28 PM UTC
Dear Client, We have identified the root of instability and have now restored performance to optimal levels. We will continue to monitor to ensure services remain fully available. Regards, Recorded Future Platform Operations
- postmortem Nov 27, 2024, 09:01 PM UTC
* **Issue:** * On the morning of November 5th \(approximately 7am EST\), Recorded Future’s platform experienced a degradation of system performance which impacted accessibility to various parts of our external API, including our playbook alert API. In addition, this incident negatively impacted end user access to our portal features such as alerts and lists. * **Cause:** * Too much load on a particular querying service was determined to be the root cause of the service disruption, which required an increase of available resources to remediate. * **Remediation / Path Forward:** * Within one hour of incident acknowledgement, the Recorded Future platform operations team engaged with our product development team to collectively increase available resources that would allow for optimal performance in the API and portal. Tentative resolution was communicated at 9:41am EST, with full closure of the incident occurring shortly before 11:30am EST. * Long term, performance improvements are planned for release pertaining to our Threat Intelligence Ransomware service, which is responsible for the majority of our long-running queries that contributed to the impact seen during this incident.