Cisco Meraki incident

Issues with Auto VPN

Major Resolved View vendor source →

Cisco Meraki experienced a major incident on September 18, 2024, lasting 12h 37m. The incident has been resolved; the full update timeline is below.

Started
Sep 18, 2024, 06:25 AM UTC
Resolved
Sep 18, 2024, 07:02 PM UTC
Duration
12h 37m
Detected by Pingoru
Sep 18, 2024, 06:25 AM UTC

Update timeline

  1. investigating Sep 18, 2024, 06:25 AM UTC

    We are aware that some customers are experiencing Meraki Auto VPN issues, and we are actively investigating. Rebooting MX/vMX devices operating in passthrough mode can be used as a workaround in the meantime.

  2. identified Sep 18, 2024, 08:38 AM UTC

    We have identified a proximate cause for the Meraki Auto VPN issues and are working on a remediation plan to restore normal service. A fix will be deployed to that effect shortly.

  3. investigating Sep 18, 2024, 11:20 AM UTC

    We continue to investigate the root cause of Meraki Auto VPN connectivity issues in MX and vMX appliances running in passthrough mode and are working to remediate them. Customers can restore service by rebooting the appliance in Passthrough Mode via the Meraki dashboard. For steps to reboot your device please follow the below knowledge base article: https://documentation.meraki.com/MX/Monitoring_and_Reporting/Using_the_MX_Live_tools#Reboot_Appliance

  4. identified Sep 18, 2024, 02:21 PM UTC

    Meraki engineering identified an issue with MX and vMX devices operating in Passthrough or VPN Concentrator mode and are working to test and deploy a fix. In the meantime, customers can reboot MX and vMX devices operating in those modes to restore service. For steps to reboot your device please follow the below knowledge base article: https://documentation.meraki.com/MX/Monitoring_and_Reporting/Using_the_MX_Live_tools#Reboot_Appliance

  5. identified Sep 18, 2024, 03:46 PM UTC

    Customers potentially affected can restore service by rebooting MX and vMX appliances operating in Passthrough or VPN Concentrator mode. Meraki Engineering has tested a fix and are in the process of deploying it. Once deployed, we anticipate that MX and vMX appliances that have not already been rebooted will experience up to two minutes of disruption to the following services: AnyConnect, eBGP, Connection Monitoring, and IPSEC VPN Tunnels. For steps to reboot your device please follow the below knowledge base article: https://documentation.meraki.com/MX/Monitoring_and_Reporting/Using_the_MX_Live_tools#Reboot_Appliance

  6. monitoring Sep 18, 2024, 05:30 PM UTC

    Meraki Engineering has begun to deploy the fix to this issue. It is expected to be complete by approximately 18:30 UTC. Once deployed, we anticipate that MX and vMX appliances that have not already been rebooted will experience up to two minutes of disruption to the following services: AnyConnect, eBGP, Connection Monitoring, and IPSEC VPN Tunnels.

  7. resolved Sep 18, 2024, 07:02 PM UTC

    This incident is now resolved. If you are still experiencing any issues, please contact Meraki Customer Support.