RFPIO experienced a critical incident on December 19, 2024 affecting US Pod2, lasting 44m. The incident has been resolved; the full update timeline is below.
Affected components
Update timeline
- investigating Dec 20, 2024, 04:39 AM UTC
We are currently investigating the issue.
- identified Dec 20, 2024, 04:39 AM UTC
A disruption in one of our services has caused login issues for some customers in a US region. We have identified the affected service and are actively working to restore it.
- monitoring Dec 20, 2024, 04:40 AM UTC
The affected service has been restored. We are continuing to monitor our services.
- resolved Dec 20, 2024, 04:41 AM UTC
The incident has been resolved. RCA: A critical issue was identified during yesterday's release deployment. To address this, a hotfix was deployed to production during peak usage hours. The problem stemmed from a bug in the release code that required immediate resolution in the live environment. Unfortunately, deploying the fix during peak hours resulted in an unintended disruption.