Greenshades experienced a major incident on January 30, 2025 affecting Year End Forms, lasting 15h 43m. The incident has been resolved; the full update timeline is below.
Affected components
Update timeline
- investigating Jan 30, 2025, 09:00 PM UTC
A subset of our Year End Forms services is currently experiencing downtime. Our IT team is diligently working to restore these services. We apologize for this inconvenience.
- identified Jan 30, 2025, 09:48 PM UTC
Restoration of services is underway. This process can take up to two hours. Again, we apologize for this inconvenience and appreciate your patience.
- identified Jan 30, 2025, 10:36 PM UTC
We are still experiencing an outage on one of our ten Year-End Forms hosting clusters. While the majority of customers remain fully operational, those on this affected cluster are unable to access Year-End Forms. We understand the urgency of restoring service and are working diligently on recovery. We will continue to provide updates here.
- monitoring Jan 31, 2025, 12:05 AM UTC
All Year-End Forms hosting clusters have been restored and services are fully operational. Our team will continue to monitor to ensure system stability.
- resolved Jan 31, 2025, 12:44 PM UTC
This incident has been resolved. The root cause was identified as an issue with the Microsoft software operating the data hosting layer, which caused a data cluster to restart unexpectedly. We appreciate your patience and understanding during this time.