Virtuagym incident

Some services are showing decreased performance.

Minor Resolved View vendor source →

Virtuagym experienced a minor incident on February 24, 2023 affecting Website and Mobile Apps and 1 more component, lasting 1h 2m. The incident has been resolved; the full update timeline is below.

Started
Feb 24, 2023, 09:30 AM UTC
Resolved
Feb 24, 2023, 10:32 AM UTC
Duration
1h 2m
Detected by Pingoru
Feb 24, 2023, 09:30 AM UTC

Affected components

WebsiteMobile AppsAPI

Update timeline

  1. investigating Feb 24, 2023, 09:30 AM UTC

    We are currently investigating an issue and working to resolve it as soon as possible. We apologize for any inconvenience this may cause and appreciate your patience. We will provide an update within 30 minutes to keep you informed on the progress of the resolution.

  2. identified Feb 24, 2023, 09:55 AM UTC

    The system is particularly vulnerable when multiple cronjobs are running at the same time. We use cronjobs to have the system schedule certain tasks, and try to avoid too many of these happening at the same time. Whilst we prevent that from happening, today the situation was aggravated by the execution of Semrushbot: a bot which is automatically clicking on every possible link on the old schedule, causing a denial of service on our platform - leading to the system being unavailable across web and apps. We are currently blocking this bots range of IP addresses as a first containment measure, and returning to normal service levels.

  3. monitoring Feb 24, 2023, 09:56 AM UTC

    A fix has been implemented and we are monitoring the results. We appreciate your patience and understanding!

  4. resolved Feb 24, 2023, 10:32 AM UTC

    This incident has been resolved.