Northpass incident

Application Outage

Critical Resolved View vendor source →

Northpass experienced a critical incident on April 29, 2025 affecting Northpass App - Azure, lasting 1h 20m. The incident has been resolved; the full update timeline is below.

Started
Apr 29, 2025, 06:22 PM UTC
Resolved
Apr 29, 2025, 07:43 PM UTC
Duration
1h 20m
Detected by Pingoru
Apr 29, 2025, 06:22 PM UTC

Affected components

Northpass App - Azure

Update timeline

  1. investigating Apr 29, 2025, 06:22 PM UTC

    We are currently investigating this issue.

  2. identified Apr 29, 2025, 06:46 PM UTC

    The issue has been identified and a fix is being implemented.

  3. monitoring Apr 29, 2025, 06:46 PM UTC

    A fix has been implemented and we are monitoring the results.

  4. resolved Apr 29, 2025, 07:43 PM UTC

    Between 14:22 and 14:46 EDT today, our entire application was unavailable due to an unexpected memory exhaustion in our backend layer. Root Cause: A high-volume enrolment process caused backend cache errors leading to an "Out of Memory" condition. Preventative Measures Script Throttling: We'll introduce rate-limiting for large-scale data loads. Capacity Expansion: Backend cache memory limits were increased.