Spruce Health incident

Search & Contact Filters experiencing intermittent errors and slowness

Minor Resolved View vendor source →

Spruce Health experienced a minor incident on May 1, 2023 affecting Web App and Mobile Apps, lasting 3h 15m. The incident has been resolved; the full update timeline is below.

Started
May 01, 2023, 07:12 PM UTC
Resolved
May 01, 2023, 10:28 PM UTC
Duration
3h 15m
Detected by Pingoru
May 01, 2023, 07:12 PM UTC

Affected components

Web AppMobile Apps

Update timeline

  1. investigating May 01, 2023, 07:12 PM UTC

    Users may be experiencing degraded performance for the following actions: - Searching for contacts or conversations: may be giving errors or returning results in a delayed manner or returning stale results - Creating conversations: maybe return errors or experiencing a lag when searching for contacts - Sending bulk messages: may be experiencing a lag where stuck in Processing state for a while or just taking longer to complete - Opening contact lists: may be returning errors or experiencing a lag in returning results Phone calls, video calls, exchanging messages (fax, secure, email or SMS) is NOT impacted and operating normally. We have identified the reason for the degraded performance and are actively working on resolving the issue.

  2. identified May 01, 2023, 07:32 PM UTC

    We have identified the reason for the degraded performance and are actively working on resolving the issue.

  3. identified May 01, 2023, 08:52 PM UTC

    We continue to actively work on the issue. We will post another update in another hour here as we assess progress of the fix.

  4. monitoring May 01, 2023, 10:00 PM UTC

    Search results and contacts are now loading without any errors. We are working to get search results to reflect latest results. Users should no longer have any issues creating conversations, sending bulk messages or opening contact lists. Phone calls, video calls, exchanging messages (fax, secure, email or SMS) are NOT impacted and operating normally. Will post an update as soon as we have search results all caught up.

  5. resolved May 01, 2023, 10:28 PM UTC

    System is fully operational now, with all search results having caught up. We're really sorry for the inconvenience caused here and have decided to operate with extra capacity to ensure that the system continues to operate normally moving forward.