Perimeter 81 incident

Some users may experience disruptions with the Silicon Valley Data Center

Major Resolved View vendor source →

Perimeter 81 experienced a major incident on October 11, 2022, lasting 4h 15m. The incident has been resolved; the full update timeline is below.

Started
Oct 11, 2022, 05:08 PM UTC
Resolved
Oct 11, 2022, 09:24 PM UTC
Duration
4h 15m
Detected by Pingoru
Oct 11, 2022, 05:08 PM UTC

Update timeline

  1. identified Oct 11, 2022, 05:08 PM UTC

    We have identified an issue with our switches in the San Jose region that may cause degraded performance with Gateways in the area. We are aware of the problem and are working to repair it.

  2. identified Oct 11, 2022, 05:09 PM UTC

    There was a failover and the connectivity should have been restored. However, some of the gateways didn’t recover, the team is investigating and working on a fix.

  3. identified Oct 11, 2022, 05:33 PM UTC

    We have identified a faulty switch in the San Jose area, and connectivity should be restored for some users in the region. We are working to restore full connectivity ASAP.

  4. identified Oct 11, 2022, 05:52 PM UTC

    Our Engineering team has restored partial connectivity. We are now working to restore full connectivity in the region

  5. identified Oct 11, 2022, 06:11 PM UTC

    The connectivity in the region is partly restored, and we are continuing our work on restoring full connectivity in the region.

  6. identified Oct 11, 2022, 06:27 PM UTC

    We are still working on restoring full connectivity for the Silicon Valley Data Center.

  7. identified Oct 11, 2022, 06:43 PM UTC

    We are still working on restoring full connectivity for the Silicon Valley Data Center.

  8. identified Oct 11, 2022, 07:13 PM UTC

    We have identified the problematic component and are still working on restoring full connectivity for the Silicon Valley Data Center.

  9. monitoring Oct 11, 2022, 08:14 PM UTC

    We have applied a fix, and the connectivity to the Silicon Valley Data Center should now return. Our Engineering team is still monitoring the connection.

  10. resolved Oct 11, 2022, 09:24 PM UTC

    This incident has been resolved. We continue to monitor the connection.