BigLeaf experienced a minor incident on June 23, 2022 affecting Gateway Cluster: Los Angeles, CA, lasting 2h 53m. The incident has been resolved; the full update timeline is below.
Affected components
Update timeline
- investigating Jun 23, 2022, 11:12 PM UTC
Today our redundant network experienced multiple events on two Tunnel Endpoint Servers within our Los Angeles Gateway Cluster. Customers who were connected through the affected servers automatically failed over to their secondary POP. Our engineering team was automatically alerted and immediately began working to determine the cause of the events and restore the affected servers. When these servers are brought back online, affected customer sites will automatically reconnect back to their primary servers. For the duration of this incident, affected customers may experience an increase in latency. Our Engineers are still actively investigating the cause of these events and we will provide updates as soon as we have additional information.
- monitoring Jun 24, 2022, 12:08 AM UTC
We believe we have identified the issue and have taken corrective action to isolate the problem. Service has been restored to normal, and we do not believe there will be any further impact. Our Engineers will continue to monitoring the affected systems for anomalies this evening.
- resolved Jun 24, 2022, 02:06 AM UTC
No further issues have been detected. This incident has been resolved.