Reinvent Telecom incident

Outside Phoenix Fiber Event

Resolved after 13 hours 52 minutes, affecting Inbound National and Outbound National, on February 21, 2023.

postmortem Feb 24, 2023, 01:52 PM UTC

## Final Update on 2/21/23 Fiber Event ## ## A fiber event on 2/21/23 \(2:02:55pm MST to 2:03:28pm MST\) in Phoenix caused a brief packet loss on an AT&T uplink circuit which could have affected some users for a short period of time \(30sec\). Transport was restored \(via the redundant path\) and all traffic continued as normal. Our network & transport redundancies performed as designed.

Started
Feb 21, 2023, 10:30 PM UTC
Resolved
Feb 22, 2023, 12:22 PM UTC
Duration
13h 52m
Detected by Pingoru
Feb 21, 2023, 10:30 PM UTC

Affected components

Inbound NationalOutbound National

Update timeline

  1. monitoring Feb 21, 2023, 10:30 PM UTC

    At approximately 2:04 PM MST there was a fiber cut in the Phoenix area that impacted some Reinvent services briefly. We are currently investigating and will be updating when we have more details. All systems are functioning normally.

  2. monitoring Feb 21, 2023, 10:32 PM UTC

    We are continuing to monitor for any further issues.

  3. resolved Feb 22, 2023, 12:22 PM UTC

    All systems are still stable at this time after a discovery of an outside entity produced a fiber cut in the Phoenix Metro Area. If you are having any issue please reach out to the ReInvent NOC. The has been considered resolved.

  4. postmortem Feb 24, 2023, 01:52 PM UTC

    ## Final Update on 2/21/23 Fiber Event ## ## A fiber event on 2/21/23 \(2:02:55pm MST to 2:03:28pm MST\) in Phoenix caused a brief packet loss on an AT&T uplink circuit which could have affected some users for a short period of time \(30sec\). Transport was restored \(via the redundant path\) and all traffic continued as normal. Our network & transport redundancies performed as designed.

Your product runs on more than Reinvent Telecom

Add the vendors you depend on and get one message when any of them reports trouble. Free for 3 vendors, no card.

Add your stack →