DRACOON incident
Degraded Performance of Storage Server (Upload)
DRACOON experienced a critical incident on October 24, 2024 affecting Upload, lasting —. The incident has been resolved; the full update timeline is below.
Affected components
Update timeline
- investigating Oct 16, 2024, 11:40 AM UTC
We are currently investigating an issue with the Storage Server (Upload). Our team is working to gather more information and resolve the issue as quickly as possible. We apologize for any inconvenience this may cause and will provide updates as soon as we have them.
- identified Oct 16, 2024, 12:49 PM UTC
We have identified the issue with the Storage Server. Our engineers are working on a resolution and we are confident that we will have a fix in place soon. We will provide more information and updates as soon as they become available.
- monitoring Oct 18, 2024, 09:32 AM UTC
The issue with Storage Server (Upload) has been resolved, and we are monitoring the situation to ensure it remains stable. We apologize for any inconvenience this may have caused and appreciate your patience.
- resolved Nov 19, 2024, 12:42 PM UTC
The issue with Storage Server (Upload) has been fully resolved. All systems are now operating normally. We apologize for any inconvenience this may have caused and appreciate your patience. If you continue to experience any issues, please don't hesitate to reach out to our support team for assistance.
- postmortem Nov 19, 2024, 12:54 PM UTC
We experienced an issue with Storage Server \(Upload\). Our team has worked diligently to identify the root cause and implement a resolution. In this post-mortem, we want to share the details of what happened, why it happened, what we did to resolve it, and what we will do to prevent similar incidents in the future. What happened? The upload was working but some customers experienced slow completion of uploads. Why did this happen? Due to a software problem exceptional high load was created on our storage system. What did we do? We were able to quickly stop the incorrect behavior of the software to improve performance. What can we do to improve? We fixed the software and improved our storage to prevent this problem from occurring again. We apologize for any inconvenience this incident may have caused. We are committed to ensuring the stability and reliability of our services and will continue to take proactive measures to prevent similar incidents from happening in the future. If you have any questions or concerns, please don't hesitate to reach out to our support team for assistance.