Otava experienced a minor incident on June 30, 2025 affecting Internet Backbone, lasting 7d. The incident has been resolved; the full update timeline is below.
Affected components
Update timeline
- investigating Jun 30, 2025, 12:13 PM UTC
Service Impacting: Yes – Services may be unavailable as engineers work to identify and resolve the issue. Description: OTAVA® engineers have identified a network degradation issue impacting services in our Austin (AU1) data center. Our team is actively working to restore full service as quickly as possible. If you have any questions or concerns regarding this incident, please contact us by logging into https://support.otava.com or calling 877-740-5028, option 3.
- identified Jun 30, 2025, 12:25 PM UTC
OTAVA engineers have identified a possible issue with an upstream provider and are working to re-route traffic.
- monitoring Jun 30, 2025, 12:28 PM UTC
Traffic has been rerouted and services are restored.
- resolved Jul 07, 2025, 12:41 PM UTC
This incident has been resolved.
- postmortem Jul 07, 2025, 08:29 PM UTC
Event: Austin \(AU1\) Network Degradation - 6/30/25 Start Time: 7:15 AM ET Resolved Time: 8:20 AM ET Cause: The ISP had a Virtual Machine \(VM\) which encountered resource exhaustion while processing a substantial volume of BGP \(Border Gateway Protocol\) route table updates. Upon re-enabling BGP, the resulting surge in route update requests overwhelmed the VM, causing a delay in the restoration of normal traffic flow. Resolution: OTAVA Network Engineers routed traffic away from the impacted ISP.