Rootly incident

Investigating Search Latency

Minor Resolved View vendor source →

Rootly experienced a minor incident on September 25, 2025 affecting Web Platform and API, lasting 4h 57m. The incident has been resolved; the full update timeline is below.

Started
Sep 25, 2025, 04:16 PM UTC
Resolved
Sep 25, 2025, 09:13 PM UTC
Duration
4h 57m
Detected by Pingoru
Sep 25, 2025, 04:16 PM UTC

Affected components

Web PlatformAPI

Update timeline

  1. investigating Sep 25, 2025, 04:16 PM UTC

    We are currently investigating increased latency in our in-app search (including alert search and incident search). Newly created resources may not be immediately searchable. Search results in-app may be slower to load than normal. Search results may be returned more slowly for certain API endpoints, including: GET /api/v1/incidents, GET /api/v1/services, GET /api/v1/groups, GET /api/v1/users, and GET /api/v1/audits. Our team is actively working on resolving this issue and will provide updates as soon as more information becomes available.

  2. monitoring Sep 25, 2025, 04:49 PM UTC

    We identified the root cause of the issue and have implemented a fix. Latencies have returned to normal and we are monitoring them going forward.

  3. resolved Sep 25, 2025, 09:13 PM UTC

    This incident has been resolved.