SR45858 - Voice Platform Impairment

Update timeline

1. investigating Mar 26, 2026, 12:33 AM UTC

   We are aware of and investigating an issue with voice services over the Detroit Network.

2. investigating Mar 26, 2026, 01:41 AM UTC

   We are continuing our investigation and have remote hands on site for assistance. We will provide another update within 60 minutes, or as one becomes available.

3. identified Mar 26, 2026, 02:18 AM UTC

   We have identified the issue and working towards restoration. We will update again when we have more information.

4. monitoring Mar 26, 2026, 03:40 AM UTC

   Our network team (along with on-site support resources) has resolved the routing issue affecting Detroit Voice services. Traffic began successfully routing at approximately 10:15 PM, and all services are currently operating normally. We are continuing to monitor stability and review the underlying cause as part of our follow-up analysis. We’ll share additional updates and a Post Mortem / RFI as more information becomes available.

5. monitoring Mar 26, 2026, 03:46 AM UTC

   We are continuing to monitor for any further issues.

6. resolved Mar 26, 2026, 04:56 PM UTC

   All services impacted by the earlier Detroit network disruption have been fully restored and remain stable. Our Network Operations team identified the issue within core infrastructure and implemented recovery actions to restore normal routing behavior. Service restoration began earlier in the evening and was confirmed fully complete at approximately 23:13 ET. We will continue to monitor the environment to ensure ongoing stability. A formal post-incident summary (RFO) will be shared once our internal review is complete. Thank you for your patience while our teams worked to resolve this issue. If you continue to experience any service concerns, please contact our Support Team at [email protected], [email protected], or [email protected].

7. postmortem Mar 26, 2026, 06:05 PM UTC

   This communication is a follow-up to the recent service disruption experienced on Wednesday evening \(3/25/2026\), involving Detroit \(DET\) voice and data services. The event was tracked via Ticket # SR45858. **Event Summary** On the evening of 3/25/2026, our Network Operations team identified a disruption affecting voice and data services within the Detroit network. Our team worked with on-site resources to restore routing stability. Service began recovering at approximately 22:15 ET and has remained stable since restoration. **Event Window** **Start of Impact:** 19:49 ET **Service Restoration Begins:** 22:15 ET **Service Restoration Complete:** 23:13 ET **Incident Impact** During the event window, customers may have experienced intermittent voice and/or data service interruptions related to a core network infrastructure issue. **Root Cause** The disruption was attributed to a failure within the core switching infrastructure in the Detroit network. Redundant network paths were available to support service continuity during the equipment failure; however, traffic did not transition to the alternate path as designed. Service was restored following the re-establishment of routing adjacencies. **Next Steps and Preventative Measures** To prevent recurrence, our team is taking the following actions: * Performing additional validation checks across the environment to confirm that the expected redundancy behavior is observed correctly, enhancing resilience against similar events. We sincerely apologize for the disruption and appreciate your continued trust as we strengthen our systems and procedures to better serve you. If you have any further questions, please contact our Support Team at 800.508.1254 or email [[email protected]](mailto:[email protected]). Sincerely, The TelNet Customer Operations Team