Apphud experienced a critical incident on July 9, 2024 affecting API and Dashboard, lasting 1h 50m. The incident has been resolved; the full update timeline is below.
Affected components
Update timeline
- investigating Jul 09, 2024, 06:55 PM UTC
We are currently investigating this issue.
- identified Jul 09, 2024, 07:05 PM UTC
The issue has been identified and a fix is being implemented.
- identified Jul 09, 2024, 07:11 PM UTC
We are continuing to work on a fix for this issue.
- monitoring Jul 09, 2024, 07:45 PM UTC
A fix has been implemented and we are monitoring the results.
- resolved Jul 09, 2024, 08:45 PM UTC
This incident has been resolved.
- postmortem Jul 09, 2024, 08:46 PM UTC
We recently experienced an outage due to an abnormally high load on our database. Our engineers investigated the issue and identified the root cause at the data center site \(abnormally high rate of TCP Retransmissions\). Following a workaround to the backend code, the issue has been resolved. Our team is currently working on replaying all failed API requests to minimize the impact on affected apps. We apologize for any inconvenience this may have caused and appreciate your understanding. Sincerely, Apphud Team