TPx Communications Outage History

TPx NOC is monitoring for updates from our IT department. They are still troubleshooting the issue. If you believe your service is impacted, please open a Technical Support case in the TPx Customer Portal at portal.tpx.com

TPx has taken appropriate action to resolve the outage and will continue to monitor. If you believe your service is impacted, please open a Technical Support case in the TPx Customer Portal at portal.tpx.com

Traffic reroutes remain in place and no new customer cases have been created. Our Provider has identified two fiber cuts that are still under construction for replacement of the damage cables. In one case a cable locate team has been engaged to review other where placement of nearby other facilities are located before digging for the damaged buried fiber. If you believe your service is impacted, please open a support case with our technical teams at www.tpx.com/support.

After our Provider completed repairs on the first of two fiber optic cuts we are seeing no packet loss on their internet connection to our network. However there are ongoing repairs being done on the second fiber cut. We are holding off on transitioning traffic back to the Provider connection until the second fiber is repaired to avoid any potential service disturbance. We do not have an ETR for the second fiber repair at this time.

We have completed moving the traffic back to our Provider internet drain connection. We have monitored services over the weekend and during peak period today with no further degradation of service. We are closing this event.

We want to make you aware of planned maintenance that Arista will be performing on the VeloCloud platform from August 26, 2026 at 11pm PDT through August 27, 2026 at 4am PDT. Most customers are not expected to experience any impact, Arista will be verifying Certificates set to “Acquire” on your Edges and Gateways have been changed to “Required.” It is expected this verification is cursory as Arista has already performed implementing the "Required" certificate in a prior maintenance activity. Arista notes that some environments may experience a brief tunnel interruption as part of the "Required" certificate change, if the certificate is set to "Acquired." What this means for you: No action is required from you at this time. If you experience an interruption that does not clear quickly, please reboot the affected Edge and contact TPx Support as soon as possible. If you believe your service is impacted, please open a support case with our technical teams at www.tpx.com/support.

Arista/Velocloud has issued Security Advisory 0144 for a security issue that could affect some Orchestrators. They are in the process of resetting certain certificate authorities to mitigate the security vulnerability. TPx VeloCloud Orchestrators are not running an Arista/Velocloud vulnerable software version. However, out of an abundance of caution, we recommend that all VeloCloud Orchestrator users reset their passwords and API tokens within the next 48 hours. New passwords should follow your organization’s security standards. For any assistance resetting your password or tokens, please submit a support request through www.tpx.com/support.

We are continuing to monitor for any further issues.

Arista has issued Security Advisory 0144. TPx VeloCloud Orchestrators are not running a vulnerable software version. However, as an added security precaution, Arista has initiated password resets for VeloCloud Orchestrator users and is invalidating existing API tokens. Users will need to set a new password before signing in. To reset your password securely, select Forgot Password on the VeloCloud Orchestrator login page. You may also receive an email from [email protected] containing a password-reset link. This is a valid email you can respond too. Customers who use API tokens will need to generate new tokens and update any applications or integrations that rely on them. New passwords should follow your organization’s security standards. For any assistance resetting your password or tokens, please submit a support request through www.tpx.com/support.

Update - All systems are operating normally. We are continuing to monitor for any issues.

We have identified a congestion issue on one of our internet links to our providers in the Dallas Area. We have engaged the provider to investigate and, in parallel, we rerouted some traffic to mitigate the congestion. We are seeing improvement and contacting customers to verify that their services are back to normal. If you believe your service is being impacted, please get in touch with our support team at www.tpx.com/support

Our Provider has not provided a cause for congestion on their internet link to our network. We will monitor traffic throughout the night and the next day to determine if additional traffic rerouting will be necessary until we have confirmation from our provider that a fix has been implemented. If you believe your service is being impacted, please get in touch with our support team at www.tpx.com/support

Our Provider has implemented configuration changes to our circuit that should correct the congestion issue experienced yesterday. We will be moving traffic back to the circuit tonight to avoid any issues during peak bandwidth utilization today. We will monitor throughout the day tomorrow to see whether their change has fully resolved the congestion issue. If you believe your service is being impacted, please get in touch with our support team at www.tpx.com/support

We are seeing our connection working as normal with no packet loss. The provider changes are working as expected. We will continue to monitor service throughout the day before resolving this event. If you believe your service is being impacted, please get in touch with our support team at www.tpx.com/support

TPx Teams are aware of some customers experiencing dropped calls when placing an inbound call on hold. TPx has reviewed call examples and has engaged our downstream SIP Trunk provider to assist in troubleshooting this issue. We have confirmed the TPx network is set to the current RFC protocols for on-hold music always. However, downstream from our connection, the call drops after about 5 seconds once being put on hold. This has been a very difficult issue to identify, and resolution relies on our downstream connections to isolate and resolve the problem on their network. We continue to escalate and follow up with our SIP Trunk provider to escalate to their downstream connections to assist with resolution. If you believe your service is impacted, please open a support case with our technical teams at www.tpx.com/support.

We have requested a subset of numbers to be blocked before they connect to our provider's network to see whether the issue occurs. Early testing has shown that the Call Hold drop does not occur. We are asking our Provider to set up a test between their downstream provider and TPx VOIP Engineering. If you believe your service is impacted, please open a support case with our technical teams at www.tpx.com/support.

A fix has been implemented and we are monitoring the results.

We are continuing to monitor for any further issues.

We have confirmed that the primary link outage was caused by a scheduled maintenance window (MOP 72515). This link successfully restored at 02:28 PST, recovering network connectivity and bringing the Las Vegas market back online. Our team is currently monitoring service stability on the active circuit. Concurrently, we are escalating the issue with the secondary provider to restore the redundant link, which remains down.

We have restored the HVAC system and reconfigured power to restore customer services. We are reviewing outstanding alarms and clearing them one by one. If you believe your service is impacted, please open a support case with our technical teams at www.tpx.com/support.

Frontier has completed the repairs, and our montoring tools see customers have restored. We are monitoring for stability and reaching out to customers for confirmation. If you believe your service is impacted, please open a support case with our technical teams at www.tpx.com/support.

Microsoft's rebalance of traffic to achieve recovery appears to be working. Some email delays may still be present due to customer email systems processing delivery of backlog messages. They are also recursively monitoring the extent of the affected environment to identify whether additional actions may be required. TPx will continue to monitor for any further issues through the next 24 hours to verify that our customer issues have been corrected. If you believe your service is impacted, please open a support case with our technical teams at www.tpx.com/support.

The National Weather Service has issued a Winter Storm Watch that includes the TPx Dallas, Atlanta, and Boston area network hubs effective Friday, January 23, 2026 through Monday, January 26, 2026. Forecast conditions include extreme cold, snow, sleet, and freezing rain, with the potential for ice accumulation. We want to assure you that the TPx NOC is actively preparing for this event. With the possibility of service impacts we would like to assure you that our dedication continues to be focused on supporting our customers. Our Support and Engineering Teams are closely monitoring the situation and will continue to do so throughout the duration of the storm. We will continue to monitor weather conditions and network performance throughout the storm. Should conditions change or service updates become necessary, we will communicate them promptly. If you believe your service is impacted, please open a support case with our technical teams at www.tpx.com/support.

TPx is monitoring the Verizon Wireless outage. Our network has not been impacted by this event, however, we understand that some customers' wireless services may not be working, restricting access to some of the services we provide. What we know is that at approximately 12:30 pm EST, over 150,000 reports of Verizon Wireless issues spiked on Down Detector. Verizon has put out a statement "Verizon engineering teams are continuing to address today's service interruptions. Our teams remain fully deployed and are focused on the issue." TPx will continue to monitor the situation, but as of 8:00 pm EST Verizon Wireless has not resolved the issue.

Our TPx Engineering team has moved the affected traffic off the affected path. Services have cleared and remained stable for 2 hours. We are awaiting our provider's update on their fix. Once we receive their fix notification, we will confirm via testing that no issues remain before moving traffic back to its primary connection. If you believe your service is impacted, please open a support case with our technical teams at www.tpx.com/support.

We have followed our vendors recommendations to restore the routing to our core router. We are completing a health check of the router. Customer services should no longer be impacted. If you believe your service is impacted, please open a support case with our technical teams at www.tpx.com/support.

TPx customers may have experienced a service interruption due to a hardware issue on the Frontier Network. We are seeing all proactive alerts for customers impacted as restored. Frontier states they are still working with their vendor to restore another card to ensure redundancy. The TPx NOC is monitoring services and will resolve this event once Frontier is hands-off. Frontier has not provided an ETR for when they will be done with full restoration. If you believe your service is impacted, please open a support case with our technical teams at www.tpx.com/support.

We are seeing that most customers have been restored. Frontier has not completed all repairs at the second location of the fiber damage. If you believe your service is impacted, please open a support case with our technical teams at www.tpx.com/support.

The TPx Support team is going through the service restoration validation process. We are still awaiting final confirmation from Frontier that they are hands off. We will update this event in the morning with an update of restoration or what has not been restored. If you believe your service is impacted, please open a support case with our technical teams at www.tpx.com/support.

Frontier has completed the repairs for both sections of the damaged fiber cable. We are seeing customer service restored. We are marking the event as resolved. If you believe your service is impacted, please open a support case with our technical teams at www.tpx.com/support.