Binary Lane incident

Host node sydcompute54 outage

Major Resolved View vendor source →

Binary Lane experienced a major incident on November 13, 2021 affecting Compute, lasting 1d 7h. The incident has been resolved; the full update timeline is below.

Started
Nov 13, 2021, 08:47 PM UTC
Resolved
Nov 15, 2021, 04:37 AM UTC
Duration
1d 7h
Detected by Pingoru
Nov 13, 2021, 08:47 PM UTC

Affected components

Compute

Update timeline

  1. investigating Nov 13, 2021, 08:47 PM UTC

    We are currently investigating this issue.

  2. identified Nov 13, 2021, 09:00 PM UTC

    This host node experienced a kernel fault requiring a power cycle to correct. All affected servers are being restarted now.

  3. monitoring Nov 13, 2021, 09:11 PM UTC

    All affected servers have been restarted. We have begun live-migrating all servers off this host node so that it can be taken offline for additional testing.

  4. resolved Nov 15, 2021, 04:37 AM UTC

    This incident has been resolved.