Voucherify incident

EU cluster - degraded performance

Major Resolved View vendor source →

Voucherify experienced a major incident on September 30, 2020 affecting EU1 - API and EU1 - Dashboard, lasting 13h 41m. The incident has been resolved; the full update timeline is below.

Started
Sep 30, 2020, 04:42 PM UTC
Resolved
Oct 01, 2020, 06:24 AM UTC
Duration
13h 41m
Detected by Pingoru
Sep 30, 2020, 04:42 PM UTC

Affected components

EU1 - APIEU1 - Dashboard

Update timeline

  1. investigating Sep 30, 2020, 04:42 PM UTC

    Communication with API is currently being impacted by the anomalous behaviour of one of our European clusters. We are investigating the issue.

  2. identified Sep 30, 2020, 04:51 PM UTC

    The issue has been identified. It was related to locks on the database which were triggered due to wrong API usage of one of the tenants. The team has applied fix which should block the bad sequences of API calls in future.

  3. monitoring Sep 30, 2020, 04:52 PM UTC

    A fix has been released and we are monitoring the results.

  4. resolved Oct 01, 2020, 06:24 AM UTC

    This incident has been resolved.