FTAPI experienced a critical incident on November 18, 2024 affecting FTAPI Cloud Systems, lasting 5h 57m. The incident has been resolved; the full update timeline is below.
Affected components
Update timeline
- investigating Nov 18, 2024, 10:26 AM UTC
We are currently investigating service interruptions for some of our customers.
- identified Nov 18, 2024, 11:30 AM UTC
The underlying issue has been identified and we are working together with our infrastructure partner to fix it.
- identified Nov 18, 2024, 12:00 PM UTC
Our infrastructure partner is working hard to fix the underlying networking problems. You can keep up to date with their incident status as well here: https://www.syseleven-status.net/incident/541
- identified Nov 18, 2024, 12:58 PM UTC
After a change in the underlying infrastructure, we are seeing improvements in network connectivity. We are currently evaluating the health of our services and are continuing to work on service recovery.
- identified Nov 18, 2024, 01:39 PM UTC
After the network fix has been implemented, we have recovered our database service and are currently seeing first customer facing services become available again.
- monitoring Nov 18, 2024, 01:59 PM UTC
More than 70% of our customer services are back online now, we are still working to bring the remaining services back up.
- monitoring Nov 18, 2024, 02:08 PM UTC
All services are operational again. We are monitoring while adjacent services proceed to recover
- monitoring Nov 18, 2024, 02:54 PM UTC
We are seeing multiple services becoming unavailable again and are working to bring them back up as soon as possible.
- monitoring Nov 18, 2024, 04:04 PM UTC
Customers are back online. We still monitoring the system.
- resolved Nov 18, 2024, 04:24 PM UTC
This incident has been resolved.