Viirtue experienced a minor incident on August 26, 2024 affecting Florida Data Center, lasting —. The incident has been resolved; the full update timeline is below.
Affected components
Update timeline
- resolved Aug 26, 2024, 04:12 PM UTC
Viirtue engineers have confirmed the Lumen circuit in the Florida data center went down between 11:25 am EST and 11:50 am EST. The circuit has been restored and all hardware in this data center is accessible. Lumen has not provided an RFO yet but when they do we will add it to the postmortem section of this incident.
- postmortem Aug 28, 2024, 01:09 PM UTC
Lumen confirmed there was a fiber cabling issue that caused the network issue that occurred in Florida. The update they provided is below: “Repair Area: Cabling Repair Action: Suspected Fiber Disturbance Repair Summary: Incident Conclusion Summary Issue Reported: RFO Root Cause: metro link bounce City the issue was isolated to: Tampa Fix or Last Action Taken: provided RFO Preventative measures that have been or will be implemented: Name of Client Approving Closure: Matt Phone Number of Client Approving Closure: 8557968351 Client Approved Closure Via: Email Notes History: 2024-08-26 19:20:04 GMT - Per my Email, I am showing that the reported service is currently up and stable. Below is a summary of actions taken to restore service: I have checked the service path and can report the following. This outage was caused by a metro link going down which isolated the node you are being serviced off of and caused downtime. The logs below are for your reference. I can hold this ticket for 24 hours. TAMP12CA4C001#show log Aug 26 15:21:34.306 UTC: %REP-4-LINKSTATUS: TenGigabitEthernet1/1 \(segment 31\) is non-operational due to port status change Aug 26 15:21:35.294 UTC: %LINEPROTO-5-UPDOWN: Line protocol on Interface TenGigabitEthernet1/1, changed state to down Aug 26 15:41:29.662 UTC: %REP-4-LINKSTATUS: TenGigabitEthernet1/1 \(segment 31\) is operational”