Heron Data experienced a minor incident on June 21, 2023 affecting Root and Transactions, lasting 12h 33m. The incident has been resolved; the full update timeline is below.
Affected components
Update timeline
- investigating Jun 21, 2023, 09:20 PM UTC
We are currently experiencing a higher than usual error rate with our API. Our team is actively investigating and working on resolving the issue. Updates to follow soon. We apologize for any inconvenience caused. Thank you for your patience.
- identified Jun 21, 2023, 09:31 PM UTC
We have identified the cause of the error rate issue and are actively working on resolving it. Thank you for your patience as we work towards a solution.
- monitoring Jun 21, 2023, 09:41 PM UTC
We have implemented mitigation measures to address the higher than usual error rate with our API. We will continue to closely monitor the situation. Thank you for your understanding.
- resolved Jun 22, 2023, 09:53 AM UTC
This incident has been resolved. We experienced a high number of API requests that were using a high amount of CPU, overwhelming our infrastructure. We shipped a change that reduced the CPU usage, and have seen normal CPU usage for the last 8 hours