Open Exchange Rates incident

API 500 errors

Major Resolved View vendor source →

Open Exchange Rates experienced a major incident on August 22, 2021 affecting Exchange Rate API, lasting 2d. The incident has been resolved; the full update timeline is below.

Started
Aug 22, 2021, 09:30 AM UTC
Resolved
Aug 24, 2021, 09:47 AM UTC
Duration
2d
Detected by Pingoru
Aug 22, 2021, 09:30 AM UTC

Affected components

Exchange Rate API

Update timeline

  1. investigating Aug 22, 2021, 09:30 AM UTC

    We are investigating a technical issue with our infrastructure that is causing API 500 errors. Please stand by for updates.

  2. identified Aug 22, 2021, 11:12 AM UTC

    We have identified the cause of the incident occurring today, and we are working on a solution. Thank you for your patience.

  3. monitoring Aug 22, 2021, 11:50 AM UTC

    A fix has been implemented and we are monitoring the results.

  4. resolved Aug 24, 2021, 09:47 AM UTC

    This incident was resolved at 11:40 UTC on Sunday 22nd August, approximately 3 hours and 45 minutes after it began. The issue related to a cache failover event, leading to certain parts of our API infrastructure becoming overburdened. While our service remained available during this time, up to approximately 50% of API requests may have received 500 errors. (NB: An earlier update to this incident report may have continued to show the API status as "partially degraded," however the service has been fully operational since the fix was implemented.) Please accept our apologies for any inconvenience caused by this incident. If you have any further comments or questions, please don't hesitate to contact us at [email protected].