WEDO incident

Very high latency creating out of memory crashes

Critical Resolved View vendor source →

WEDO experienced a critical incident on December 21, 2021 affecting WEDO, lasting 49m. The incident has been resolved; the full update timeline is below.

Started
Dec 21, 2021, 12:38 PM UTC
Resolved
Dec 21, 2021, 01:27 PM UTC
Duration
49m
Detected by Pingoru
Dec 21, 2021, 12:38 PM UTC

Affected components

WEDO

Update timeline

  1. investigating Dec 21, 2021, 12:38 PM UTC

    We are currently investigating this issue.

  2. identified Dec 21, 2021, 12:40 PM UTC

    We have a issue with our latest deployment so we decided to block access while reverting the changes.

  3. monitoring Dec 21, 2021, 01:17 PM UTC

    We've reverted to an older version and are monitoring the situation.

  4. monitoring Dec 21, 2021, 01:26 PM UTC

    We are continuing to monitor for any further issues.

  5. resolved Dec 21, 2021, 01:27 PM UTC

    The system is back online.