Keygen incident

Under DDoS

Major Resolved View vendor source →

Keygen experienced a major incident on February 5, 2024 affecting Current status by service (API) and Current status by service (Dashboard) and 1 more component, lasting 1d 9h. The incident has been resolved; the full update timeline is below.

Started
Feb 05, 2024, 10:12 AM UTC
Resolved
Feb 06, 2024, 08:04 PM UTC
Duration
1d 9h
Detected by Pingoru
Feb 05, 2024, 10:12 AM UTC

Affected components

Current status by service (API)Current status by service (Dashboard)Current status by service (Webhooks)

Update timeline

  1. investigating Feb 05, 2024, 10:12 AM UTC

    As of 23:48:02, we have been experiencing a major DDoS attack. We're working with our infrastructure provider on a resolution. Thank you for your patience.

  2. resolved Feb 06, 2024, 08:04 PM UTC

    We were able to locate the source of the problem on our end that was limiting our scaling under certain loads. We've deployed a fix and are now accepting all traffic. If there's a silver lining, it's that we fixed a long standing performance problem that reared itself sporadically, and now we know why. We're going to write up a complete postmortem soon. Thanks so much for your patience, and I sincerely apologize for the problems this outage has caused all your businesses over the last 36 hours. It's been a nightmare, but we came out stronger.