WiscNet incident

Milwaukee Core Router - Outage | 2281701

Major Resolved View vendor source →

WiscNet experienced a major incident on August 25, 2026 affecting Algoma School District and All Saints Catholic School - Berlin and 1 more component, lasting 22h 10m. The incident has been resolved; the full update timeline is below.

Started
Aug 25, 2026, 06:16 PM UTC
Resolved
Aug 26, 2026, 04:26 PM UTC
Duration
22h 10m
Detected by Pingoru
Aug 25, 2026, 06:16 PM UTC

Affected components

Algoma School DistrictAll Saints Catholic School - BerlinArrowhead UHS School DistrictBellin College IncBonduel School DistrictBowler School DistrictWaukesha County Federated Library System (Bridges Library System)Bridges Library SystemBrighton #1 School DistrictBristol School District #1

Update timeline

  1. monitoring Aug 25, 2026, 06:16 PM UTC

    Summary: two line cards in a downtown Milwaukee core router crashed at the same time. They automatically recovered and our technicians are working with the vendor to determine the root cause of the outage. 2026-08-25 11:03:14 CDT - outage start time 2026-08-25 11:07:37 CDT - outage end time 2026-08-25 11:24 CDT - high priority ticket created with the router vendor

  2. monitoring Aug 25, 2026, 09:13 PM UTC

    An additional router line card in Madison is impacted and we've updated the case to critical with the router vendor for next steps. Summary: three router line cards, two in Milwaukee and one in Madison, have crashed and rebooted today. They automatically recovered and our technicians are working with the vendor to determine the root cause of the outage. 2026-08-25 11:03:14 CDT - outage start time 2026-08-25 11:07:37 CDT - outage end time 2026-08-25 11:24 CDT - high priority ticket created with the router vendor 2026-08-25 15:45 CDT - ticket escalated and set to critical due to lack of response from the vendor 2026-08-25 15:54 CDT - second router added to the router vendor ticket

  3. monitoring Aug 25, 2026, 10:36 PM UTC

    The router vendor has identified a software bug and has recommended a configuration workaround that we have applied. We will be evaluating alternative code trains while this mitigation is in place. There is no expected impact at this time. 2026-08-25 11:03:14 CDT - outage start time 2026-08-25 11:07:37 CDT - outage end time 2026-08-25 11:24 CDT - high priority ticket created with the router vendor 2026-08-25 15:45 CDT - ticket escalated and set to critical due to lack of response from the vendor 2026-08-25 15:54 CDT - second router added to the router vendor ticket 2026-08-25 17:25 CDT - vendor confirmed a software bug and a mitigation 2026-08-25 17:35 CDT - mitigation applied to the all routers impacted by this bug

  4. resolved Aug 26, 2026, 04:26 PM UTC

    This incident has been resolved.

  5. postmortem Aug 26, 2026, 04:31 PM UTC

    Date & Time of Incident: 11:03 AM 8/25/2026 Duration: 5 minutes Technician\(s\): Carter Jensen Review Date: 8/26/2026 Brief Summary: Alarms came in for sit at 11:03 AM and cleared at 10:08 AM. Three router line cards, two in Milwaukee and one in Madison failed. Root Cause: Software bug on equipment