Poka incident

Databases in the US region are under unusual load

Minor Resolved View vendor source →

Poka experienced a minor incident on May 11, 2020 affecting Databases (US) and Customer instances, lasting 4h 35m. The incident has been resolved; the full update timeline is below.

Started
May 11, 2020, 05:45 PM UTC
Resolved
May 11, 2020, 10:20 PM UTC
Duration
4h 35m
Detected by Pingoru
May 11, 2020, 05:45 PM UTC

Affected components

Databases (US)Customer instances

Update timeline

  1. identified May 11, 2020, 05:45 PM UTC

    The databases in the US region are under unusual load, it seems to be an aftermath of yesterday's database upgrade. We identified the issue and we are currently working toward a fix and we will update you with the progress.

  2. monitoring May 11, 2020, 07:51 PM UTC

    We have applied a series of commands to reduce the load on our databases. Around 2pm EDT the latency of our service was back to an acceptable range. We are still monitoring this situation closely and we will update you as soon as the load is back to normal.

  3. resolved May 11, 2020, 10:20 PM UTC

    We have managed to bring back the latency to normal values. We will continue to monitor these metrics closely and we will update the status page if a new incident occur.