Ribbon Health incident

API Outage

Notice Resolved View vendor source →

Ribbon Health experienced a notice incident on May 12, 2023, lasting —. The incident has been resolved; the full update timeline is below.

Started
May 12, 2023, 02:36 PM UTC
Resolved
May 12, 2023, 01:00 PM UTC
Duration
Detected by Pingoru
May 12, 2023, 02:36 PM UTC

Update timeline

  1. resolved May 12, 2023, 02:36 PM UTC

    We experienced a brief API outage between 9-9:15AM ET with about 10-12 mins of downtime.

  2. postmortem May 18, 2023, 08:11 PM UTC

    The issue was caused by our API Redis instance running out of memory. As an immediate term fix we increased the size of the Redis instances in order to reduce latency. We have been monitoring the API the past few days and are seeing the service maintain the baseline performance we expect. We are also profiling our API platform to better understand where the spikes in memory are coming from and addressing those at core to ensure that this sort of incident does not happen again. Please don’t hesitate to reach out if you have any further questions or concerns in the meantime. We sincerely apologize for this incident and the impact it had on your team and your end-users. Ribbon Team