Virtuagym incident

API performance issues

Major Resolved View vendor source →

Virtuagym experienced a major incident on May 23, 2024 affecting API, lasting 20h 51m. The incident has been resolved; the full update timeline is below.

Started
May 23, 2024, 01:21 PM UTC
Resolved
May 24, 2024, 10:12 AM UTC
Duration
20h 51m
Detected by Pingoru
May 23, 2024, 01:21 PM UTC

Affected components

API

Update timeline

  1. investigating May 23, 2024, 01:21 PM UTC

    We are currently investigating a spike in error counts for our API clusters.

  2. identified May 23, 2024, 01:23 PM UTC

    The issue has been identified as a failed deployment of a configuration change. We are currently working on correcting this failed deployment.

  3. identified May 23, 2024, 01:39 PM UTC

    We are continuing to work on a fix for this issue. The API cluster is now receiving requests with degraded capacity.

  4. identified May 23, 2024, 02:31 PM UTC

    A fix has been deployed for the deployment failure, we are now verifying the new deployment is operating as expected.

  5. monitoring May 23, 2024, 03:46 PM UTC

    A fix has been implemented and we are monitoring the results.

  6. resolved May 24, 2024, 10:12 AM UTC

    This incident has been resolved.