Auvik incident

Service Disruption - Auvik Site Performance and Device Health Issues

Minor Resolved View vendor source →

Auvik experienced a minor incident on June 3, 2024 affecting us1.my.auvik.com and us2.my.auvik.com and 1 more component, lasting 4h 4m. The incident has been resolved; the full update timeline is below.

Started
Jun 03, 2024, 02:04 PM UTC
Resolved
Jun 03, 2024, 06:08 PM UTC
Duration
4h 4m
Detected by Pingoru
Jun 03, 2024, 02:04 PM UTC

Affected components

us1.my.auvik.comus2.my.auvik.comus3.my.auvik.comus4.my.auvik.comus5.my.auvik.comeu2.my.auvik.comau1.my.auvik.comca1.my.auvik.com

Update timeline

  1. identified Jun 03, 2024, 02:04 PM UTC

    We’ve identified the source of the service disruption with site performance and device discovery. In some cases, this may include the Map and Network dashboard. We are currently testing a fix for the issue and working to restore service as quickly as possible.

  2. identified Jun 03, 2024, 03:01 PM UTC

    We’ve identified the source of the service disruption with site performance and device discovery. In some cases, this may include the Map and Network dashboard. We will deploy a hotfix to the affected clusters starting at 15:30 UTC (11:30 EDT), which will take approximately two hours to deploy. During this window, alerting and site communication may be delayed. We apologize for this inconvenience. We will monitor the progress and provide updates here, as needed.

  3. monitoring Jun 03, 2024, 03:31 PM UTC

    We’ve identified the source of the service disruption with site performance and device discovery. In some cases, this may include the Map and Network dashboard. We have begun deploying the hotfix, which is estimated to take approximately two hours to fully deploy. During this window, alerting and site communication may be interrupted or delayed. We apologize for this inconvenience. We will monitor the progress and provide updates here, as well as the banner on the website.

  4. monitoring Jun 03, 2024, 05:20 PM UTC

    We’ve identified the source of the service disruption with site performance and device discovery. In some cases, this may include the Map and Network dashboard. We have deployed the hotfix. The application is taking longer to recover than anticipated but is recovering. We are anticipating another hour for all sites to recover. During this window, alerting and site communication may be interrupted or delayed. We apologize for this inconvenience. We will monitor the progress and provide updates here and the banner on the website.

  5. resolved Jun 03, 2024, 06:08 PM UTC

    The fix for service disruption with site performance and device discovery has been fully deployed and implemented. The source of the disruption has been resolved, and services have been fully restored. There may be a slight delay with some connectors reconnecting and map updating, but this will resolve itself. Delays with alerts have ended, and sites are again communicating as normal. A Root Cause Analysis (RCA) will follow after a full review.

  6. postmortem Jun 20, 2024, 02:50 PM UTC

    Please see [Performance Issue - Map Rendering Delayed on US Cluster Customers](https://status.auvik.com/incidents/6t543bp2xdwr) for post mortem.