Real World Technology Solutions incident

Storage Fabric Availability in syd02

Major Resolved View vendor source →

Real World Technology Solutions experienced a major incident on January 28, 2024 affecting Virtual Machine Hosting and Co-location and 1 more component, lasting 7d 14h. The incident has been resolved; the full update timeline is below.

Started
Jan 28, 2024, 11:37 AM UTC
Resolved
Feb 05, 2024, 02:19 AM UTC
Duration
7d 14h
Detected by Pingoru
Jan 28, 2024, 11:37 AM UTC

Affected components

Virtual Machine HostingCo-locationWeb HostingPrivate WAN (MPLS VPN)

Update timeline

  1. investigating Jan 28, 2024, 11:37 AM UTC

    Engineers are investigating an issue affecting a storage fabric in our syd02 data centre. Currently multiple services are impacted by a suspected hardware failure.

  2. identified Jan 28, 2024, 11:40 AM UTC

    Engineers have identified a fault condition in a redundant storage fabric where controller B has failed, but some volumes have not successfully migrated due to a dirty cache operation. Engineers are liaising with vendor technicians to identify next steps.

  3. identified Jan 28, 2024, 12:16 PM UTC

    Engineers have arrived on site.

  4. monitoring Jan 28, 2024, 12:53 PM UTC

    Engineers have corrected the hardware fault and restored all ancillary services. Any customers who continue to have any service issues should contact our help desk.

  5. monitoring Feb 05, 2024, 02:18 AM UTC

    We are continuing to monitor for any further issues.

  6. resolved Feb 05, 2024, 02:19 AM UTC

    This incident has been resolved.