Seven Senders incident
7S Return Portal Temporarily Unavailable
Seven Senders experienced a critical incident on September 18, 2024 affecting Returns Portal, lasting 1h 13m. The incident has been resolved; the full update timeline is below.
Affected components
Update timeline
- investigating Sep 18, 2024, 09:50 AM UTC
We are currently experiencing a technical issue that is preventing access to the return portal. Our team is addressing the problem with the highest priority.
- resolved Sep 18, 2024, 11:04 AM UTC
Following yesterday's Kubernetes and Network Upgrade, the Return Portal API server encountered issues with DNS resolution/communication, causing this outage. After manually restarting the servers today, the service was fully restored after some time To prevent future occurrences, we're evaluating the best approach. Currently, extending the /health application feature to validate all critical communications seems to be the most effective solution. This will enable Kubernetes to automatically restart the application and trigger a PagerDuty incident for immediate action