Is CyberLynk down?

One of our upstream providers in our Milwaukee data center is experiencing an outage and we are following their updates as they address the issue. Customers traversing this provider may experience temporary latency/packet loss as traffic is automatically rerouted over our other providers.

The upstream provider has acknowledged the issue and is working to identify the problem. All customer traffic was automatically moved to other providers and we are continuing to monitor.

The upstream provider has located a fiber cut and is working to repair it. Since there is no ongoing impact to customer traffic, our next update will be provided when this has been resolved.

This incident has been resolved.

Our NOC is investigating degraded performance on some routes to our PHX1 data center.

A fix has been implemented and we are monitoring the results.

This incident has been resolved.

We are observing some FreePBXHosting VPS order provisioning failures as a result of an ongoing Github outage that is causing the process to timeout. Our engineers are monitoring this situation and any customers encountering issues can reach out to [email protected] for assistance. We will provide updates as they become available.

Our engineers are observing successful VPS provisioning as Github continues to work to resolve their outage on their end. We will continue to monitor and provide updates as needed.

Github status reflects that their outage has been resolved. Our engineers have verified that VPS provisioning now functions normally.

One of our upstream providers in our Phoenix data center is showing some packet loss for ICMP/SNMP traffic and we are following their updates as they address the issue. Customers with monitoring systems traversing this provider may be seeing loss for certain health checks. This does not appear to affect other types of UDP/TCP traffic at this time.

Our upstream provider has confirmed the degraded performance is related to the temperature issue referenced in this incident: https://www.cyberlynkstatus.net/incidents/9yp2dn73jvp6 We will provide an update when this is resolved.

Our NOC team has moved remaining traffic off of this provider and we are seeing stability across the network. We are continuing to monitor.

We are continuing to monitor updates from this provider. Since this circuit is not impacting customer traffic, the next update will be provided when we have received an all-clear from the provider and have observed stability across the path.

The upstream provider has provided an all-clear, and we will reintroduce the circuit to our bandwidth mix after an observation period.

Our Phoenix data center is experiencing increased temperatures, which is causing issues with a subset of network switches. This is impacting some of our services in the Phoenix data center. The data center operator is aware of the issue and is working on a fix. We will continue to monitor and provide updates as they are received.

Impacted services are being migrated to healthy network paths and should be recovering shortly. We are continuing to monitor for any additional alarms as our PHX data center works to resolve the cooling issue. The data center facilities team has HVAC vendors on site to assist with recovery.

All services that were experiencing a network outage are now recovering. Temperatures are still elevated, and we are continuing to monitor for updates, and are monitoring for any other impacts to our equipment.

Temperatures appear to have stabilized or improved slightly, however they are still elevated. The data center is continuing to work with their vendor on a fix.

Our data center provider is continuing to work with their vendor on a fix. We are continuing to see stable (but high) temperatures. There is currently no ETR.

Our data center provider has provided this update: PHX-01 is experiencing elevated white space temperatures caused by multiple utility bump events attributable to overnight storms in the area. We have on-site vendors working rapidly to resolve the situation and restore adequate cooling. Technicians have activated mitigation efforts to reduce rising space temperatures. Thus far we have restored Chiller D into operation as of 7:45 am local time. Additional remediation measures include the following action items (anticipated commencement local time; anticipated completion local time): -Chiller C restoration (targeted 12:30 pm) -Temporary on floor cooling and heat removal equipment added (approximately 10:00 am) -Additional temporary chiller and temporary backup generator added (targeted approximately 4:00 pm) Following the restoration of Chiller D, we have seen significant temperature reductions and expect that reduction to continue over the next 60 minutes.

Temperatures are slowly dropping and we are continuing to monitor.

Ambient temperatures continue to decrease steadily, and alarms are beginning to clear. It may take a couple more hours for temperatures to fully return to normal, however there is no customer impact. We are closing out this incident while we continue to monitor.