Cigo Tracker experienced a major incident on February 11, 2022 affecting Dispatch Web Platform and Public API and 1 more component, lasting 32m. The incident has been resolved; the full update timeline is below.
Affected components
Update timeline
- investigating Feb 11, 2022, 07:13 PM UTC
We are experiencing a system outage, and are investigating the issue.
- monitoring Feb 11, 2022, 07:21 PM UTC
The issue seems to have been resolved; we're still seeing some degraded performance as things stabilize. We've identified the cause of the issue, and will further investigate how to prevent it from re-occurring in the future. We apologize for the downtime experienced.
- resolved Feb 11, 2022, 07:45 PM UTC
This incident has been resolved, and we will continue our investigation with our Cloud hosting provider to better grasp what happened, and how we can prevent it for the future.
- postmortem Feb 13, 2022, 12:29 AM UTC
After reviewing this incident with the Microsoft Azure OSS \(Operations support systems\) team, the issue seemed to have been related to a 30 minutes outage between our Virtual Network and the Azure DNS \(from between 1:45 pm and 2:15 pm EST or 18:45 and 19:15 UTC\). Based on the recommendations we were given, our operations team has made some initial configuration adjustments that should prevent this issue from re-occurring in the future. We’re also investigating and implementing additional fallbacks to continue to ensure the highest system availability possible. We apologize for the inconvenience this may have caused to your operations, your fulfilment teams, and your end consumers.