PayTrace experienced a major incident on May 29, 2024 affecting Virtual Terminal, lasting 1d 2h. The incident has been resolved; the full update timeline is below.
Affected components
Update timeline
- investigating May 29, 2024, 08:24 PM UTC
We are currently investigating a latency issue when signing into PayTrace. We appreciate your patience as we work towards a resolution.
- investigating May 29, 2024, 09:47 PM UTC
Our teams are still investigating the root cause of this issue, and have validated that the performance of our login page is back up and running. You are now able to log in like normal. We have all hands on deck to find what caused this issue and to put in a permanent fix. Once we have done that, we will provide more information about the incident here shortly.
- monitoring May 29, 2024, 10:31 PM UTC
A fix has been implemented and we are monitoring the results. We will be publishing a post-mortem here shortly. Thank you for your patience during this issue. The PayTrace Team
- monitoring May 30, 2024, 09:20 PM UTC
Our team has identified a DNS issue that impacted a large quantity of users from being able to login to their account. Our teams have implemented a number of changes as a result, and were able to restore service for these users. Performance has been stable for roughly 24 hours. Our teams will continue to monitor site availability closely and will communicate out if there are any further disruptions. Sincerely, PayTrace
- resolved May 30, 2024, 11:04 PM UTC
This incident has been resolved.