Rippling incident

Issue with WiFi policies

Minor Resolved View vendor source →

Rippling experienced a minor incident on September 11, 2025 affecting Devices app, lasting 6d 1h. The incident has been resolved; the full update timeline is below.

Started
Sep 11, 2025, 08:21 PM UTC
Resolved
Sep 17, 2025, 09:22 PM UTC
Duration
6d 1h
Detected by Pingoru
Sep 11, 2025, 08:21 PM UTC

Affected components

Devices app

Update timeline

  1. investigating Sep 11, 2025, 08:21 PM UTC

    Our engineering team is investigating an issue with the deployment of WiFi policies that results in the policy being removed and re-added multiple times. This results in devices losing and gaining WiFi connection repeatedly.

  2. identified Sep 11, 2025, 11:30 PM UTC

    The issue has been identified and a fix is being implemented.

  3. investigating Sep 12, 2025, 03:18 AM UTC

    - We are confident that this issue is affecting WiFi policies, and not other policies - The issue is affecting approximately 200 companies - Based on our investigation so far, se believe there is a race condition that is resulting in some WiFi policies being removed - We have a code change ready to deploy that will mitigate most of the issue as we continue to investigate the root cause - Our engineering team will continue to investigate overnight, and we will come back with another update first in the morning

  4. monitoring Sep 12, 2025, 03:12 PM UTC

    A fix has been implemented and we are monitoring the results.

  5. resolved Sep 17, 2025, 09:22 PM UTC

    This incident has been resolved.