SMRTs incident

Degraded Performance

Minor Resolved View vendor source →

SMRTs experienced a minor incident on August 8, 2017, lasting 3h 36m. The incident has been resolved; the full update timeline is below.

Started
Aug 08, 2017, 01:07 PM UTC
Resolved
Aug 08, 2017, 04:43 PM UTC
Duration
3h 36m
Detected by Pingoru
Aug 08, 2017, 01:07 PM UTC

Update timeline

  1. identified Aug 08, 2017, 01:07 PM UTC

    The system is currently running slower than normal. We've identified and are working on resolving this issue.

  2. identified Aug 08, 2017, 02:03 PM UTC

    While the system did stabilize for a while, SMRT is still experiencing issues in detailing. Relevant staff is working on resolving the issue right now.

  3. monitoring Aug 08, 2017, 03:09 PM UTC

    System is operational again. We're actively monitoring the system should the issue arise again. We will update you with a post mortem soon

  4. resolved Aug 08, 2017, 04:43 PM UTC

    The system has been operating normally for the past hour. We apologize for the disruption to this morning's workflow. A new version of SMRT, released last night, caused the system to operate poorly (to say the least) under full load. We are revising our internal testing practices to prevent such load-balancing issues in the future.