TrackVia experienced a minor incident on July 28, 2020 affecting Commercial Cloud and HIPAA Cloud and 1 more component, lasting 8h 59m. The incident has been resolved; the full update timeline is below.
Affected components
Update timeline
- monitoring Jul 28, 2020, 02:08 PM UTC
Our vendor is currently experiencing an outage which may impact portions of the TrackVia email service. We our monitoring the situation and will report on developments as they occur.
- monitoring Jul 28, 2020, 02:53 PM UTC
No new information has been provided. We are continuing to monitor our vendor's situation and will report on developments as they occur.
- monitoring Jul 28, 2020, 04:54 PM UTC
Our Vendor is still seeing mail and stat delays (including Legacy and New Marketing Campaigns). Mail is being accepted but could be stuck in queue. Users may be experiencing a higher volume of API call errors, especially 5xx errors around 9:45 AM MT. We are continuing to monitor the situation and will report on developments as they occur.
- monitoring Jul 28, 2020, 06:18 PM UTC
Vendor is receiving and delivering mail as expected (NOT including Legacy or New Marketing Campaigns). Due to an issue in one of our data centers this morning, mail received from approximately 6:00AM MT - 6:15AM MT is still stuck in delivery. Vendor is working to get those delayed messages delivered as quickly as possible.
- monitoring Jul 28, 2020, 06:54 PM UTC
Vendor have identified the source of the issue which has been affecting email services. Their team has tested the remediation steps and are now working toward recovering all remaining impacted services.
- monitoring Jul 28, 2020, 07:50 PM UTC
Vendor has recovered the remaining impacted services and are currently monitoring system performances.
- resolved Jul 28, 2020, 11:08 PM UTC
Vendor has monitored our system and confirmed that the issue has been resolved.