TrackVia incident
Partial System Outage - Commercial, Private and Gov Cloud
Resolved after 48 minutes, affecting Commercial Cloud and Private Cloud and 1 more, on December 15, 2021.
# AWS Summary 12:14 PM PST Between 7:14 AM PST and 7:59 AM PST, customers experienced elevated network packet loss that impacted connectivity to a subset of Internet destinations. Traffic within AWS Regions, between AWS Regions, and to other destinations on the Internet was not impacted. The issue was caused by network congestion between parts of the AWS Backbone and a subset of Internet Service Providers, which was triggered by AWS traffic engineering, executed in response to congestion outside of our network. This traffic engineering incorrectly moved more traffic than expected to parts of the AWS Backbone that affected connectivity to a subset of Internet destinations. The issue has been resolved, and we do not expect a recurrence
Affected components
Update timeline
- investigating Dec 15, 2021, 03:42 PM UTC
TrackVia infrastructure is temporarily unreachable for some of our customers. We are investigating the issue and will post updates as we work towards a solution.
- investigating Dec 15, 2021, 03:51 PM UTC
The TrackVia commercial environment is now experiencing the same issue.
- monitoring Dec 15, 2021, 03:59 PM UTC
AWS has identified Internet connectivity Issues in their California and Oregon sites. TrackVia continues to monitor the situation and will provide updates as more information becomes available.
- monitoring Dec 15, 2021, 04:09 PM UTC
All TrackVia environments are now reachable. We are continuing to monitor the situation for additional impact.
- resolved Dec 15, 2021, 04:31 PM UTC
AWS is reporting the issue is resolved and TrackVia has confirmed all services are processing normally.
- postmortem Dec 15, 2021, 10:20 PM UTC
# AWS Summary 12:14 PM PST Between 7:14 AM PST and 7:59 AM PST, customers experienced elevated network packet loss that impacted connectivity to a subset of Internet destinations. Traffic within AWS Regions, between AWS Regions, and to other destinations on the Internet was not impacted. The issue was caused by network congestion between parts of the AWS Backbone and a subset of Internet Service Providers, which was triggered by AWS traffic engineering, executed in response to congestion outside of our network. This traffic engineering incorrectly moved more traffic than expected to parts of the AWS Backbone that affected connectivity to a subset of Internet destinations. The issue has been resolved, and we do not expect a recurrence
Your product runs on more than TrackVia
Add the vendors you depend on and get one message when any of them reports trouble. Free for 3 vendors, no card.
Amazon Web Services