Delayed check state updates in the M2 locations
Timeline · 3 updates
- identified Sep 08, 2026, 08:51 AM UTC
Impact: Some checks did not update their state. A check could stay in its last known state (for example UP or DOWN) longer than expected. During this period, state changes were delayed and some alert notifications were delayed. Checks continued to run, and check results were collected. No monitoring data was lost. We are investigating an issue with check state processing in one monitoring region. Some checks show a stale state and do not transition between UP and DOWN as expected. Alert notifications for affected checks can be delayed.
- monitoring Sep 08, 2026, 11:21 AM UTC
A patch has been released to tolerate intermediate failures on a large amount of state transitions. The system is back to normal, we are monitoring the state.
- resolved Sep 10, 2026, 01:51 PM UTC