Factorial HR incident
Slower response times and timeouts - advanced reports
Factorial HR experienced a critical incident on February 3, 2025 affecting API & backend and Factorial website, lasting 1d 4h. The incident has been resolved; the full update timeline is below.
Affected components
Update timeline
- identified Feb 03, 2025, 01:23 PM UTC
Our application is experiencing slower response times than usual. This will be most noticeable at peak hours like 13:00 and 14:00 UTC, when some requests could even timeout and require re-submission. We are currently working on several fixes at both the application and infrastructure layer to restore our usual quality of service. We will update this incident as soon as they are deployed. Apologies for the inconvenience.
- monitoring Feb 03, 2025, 05:23 PM UTC
A fix has been implemented and we are monitoring the results.
- investigating Feb 04, 2025, 11:47 AM UTC
This seems an unrelated issue, but we are currently facing a major outage in the application. We are investigating and will update as soon as we have more details on the reason and the estimated time of recovery.
- identified Feb 04, 2025, 11:55 AM UTC
We have identified the source of the issue and we are applying a mitigation to restore service as soon as possible.
- monitoring Feb 04, 2025, 12:05 PM UTC
We have restored the service, although the Reports functionality is currently unavailable.
- resolved Feb 04, 2025, 05:28 PM UTC
The performance issue we started experiencing yesterday has been resolved. Please keep in mind, advanced reports are still unavailable. We will reenable them in the next 24h. Apologies for the inconvenience. Update: Reports have been reenabled on February 5th at 8:15 UTC