M.D.G. IT incident

Disk performance degradation

Minor Resolved View vendor source →

M.D.G. IT experienced a minor incident on June 3, 2015, lasting 32m. The incident has been resolved; the full update timeline is below.

Started
Jun 03, 2015, 01:42 AM UTC
Resolved
Jun 03, 2015, 02:14 AM UTC
Duration
32m
Detected by Pingoru
Jun 03, 2015, 01:42 AM UTC

Update timeline

  1. identified Jun 03, 2015, 01:42 AM UTC

    A disk failure on an SSD SAN array is causing degraded IO performance on some servers as the array rebuilds onto a hot-spare. During this time servers may experience higher latency for database transactions and other disk bound operations, causing reduced performance of frontend applications. This is affecting servers using SY-1-1-HISSD for underlying storage. No data loss has been sustained. The ETA to raid rebuild and full performance is 25 minutes (12:05 pm AEST).

  2. resolved Jun 03, 2015, 02:14 AM UTC

    Full disk performance has been resolved as of approximately 12:06 pm AEST