doxy.me incident

Providers Unable To Log Into Accounts

Major Resolved View vendor source →

doxy.me experienced a major incident on May 17, 2022 affecting Doxy.me API, lasting 4h 53m. The incident has been resolved; the full update timeline is below.

Started
May 17, 2022, 02:19 PM UTC
Resolved
May 17, 2022, 07:12 PM UTC
Duration
4h 53m
Detected by Pingoru
May 17, 2022, 02:19 PM UTC

Affected components

Doxy.me API

Update timeline

  1. investigating May 17, 2022, 02:19 PM UTC

    We are seeing an issue where providers are unable to sign in to their accounts. After resetting passwords and checking reCaptcha, we are still unable to successfully log in. Our developers are actively researching this issue.

  2. monitoring May 17, 2022, 02:28 PM UTC

    A fix has been implemented and we are seeing successful reports of the accounts being able to be accessed. We are continuing to monitor this incident to ensure it is fully resolved.

  3. resolved May 17, 2022, 07:12 PM UTC

    The reports from login issues have ceased. Our support team has confirmed providers reporting the problems have regained access to their accounts. We will provide an RCA in the coming days.

  4. postmortem May 23, 2022, 06:33 PM UTC

    **Summary of event:** On 5/17/22 from 3:32 to 10:26 AM ET, some Providers were unable to log in to their accounts. The reCAPTCHA that is in place to prove that users are not robots was preventing the logins. **Business Impacts:** A limited number of providers were unable to host sessions with their clients. **Root cause:** A configuration within the reCAPTCHA integration was incorrect. **How was the issue resolved:** We identified the incorrect setting and applied an update to correct the misconfiguration. **Preventative next steps:** Scenarios identified are being added to our QA testing processes, both manual and automated going forward.