Spruce Health incident

Search & Contact Filters experiencing intermittent errors and slowness

Minor Resolved View vendor source →

Spruce Health experienced a minor incident on September 25, 2023 affecting Web App and Mobile Apps, lasting 2h 15m. The incident has been resolved; the full update timeline is below.

Started
Sep 25, 2023, 09:32 PM UTC
Resolved
Sep 25, 2023, 11:48 PM UTC
Duration
2h 15m
Detected by Pingoru
Sep 25, 2023, 09:32 PM UTC

Affected components

Web AppMobile Apps

Update timeline

  1. investigating Sep 25, 2023, 09:32 PM UTC

    Users may be experiencing degraded performance for the following actions: - Searching for contacts or conversations: may be giving errors, returning results in a delayed manner or returning stale results - Creating conversations: maybe return errors or experiencing a lag when searching for contacts - Sending bulk messages: may be experiencing a lag where stuck in Processing state for a while or just taking longer to complete - Opening contact lists: may be returning errors or experiencing a lag in returning results Phone calls, video calls, exchanging messages (fax, secure, email or SMS) is NOT impacted and operating normally.

  2. resolved Sep 25, 2023, 11:48 PM UTC

    We identified the reason for performance degradation to be an imbalance of data spread across the cluster. We have since resolved this issue and ensured that all stale search results have been cleared. The system is fully operational at this point.