3stepIT incident

Asset performance issues

Notice Resolved View vendor source →

3stepIT experienced a notice incident on September 17, 2019 affecting 3StepIT AssetNG Service, lasting 59d 2h. The incident has been resolved; the full update timeline is below.

Started
Sep 17, 2019, 09:00 AM UTC
Resolved
Nov 15, 2019, 11:00 AM UTC
Duration
59d 2h
Detected by Pingoru
Sep 17, 2019, 09:00 AM UTC

Affected components

3StepIT AssetNG Service

Update timeline

  1. investigating Sep 04, 2019, 07:03 AM UTC

    We have identified performance issues in Asset registry background processes. Corrective actions have started, and we keep monitoring system performance continuously. We apologise for the situation and try to restore normal performance as soon as possible

  2. identified Sep 04, 2019, 07:04 AM UTC

    The issue has been identified and a fix is being implemented.

  3. identified Sep 11, 2019, 11:05 AM UTC

    Currently main perfomance is still degraded in larger environment when accessing Acceptance of deliveries and End of lease services. We have adjusted system setting to ensure better background performace, this has partly helpded to restore system performance. We still need to implement hotfix to asset management to get performance in normal level, estimated time to deploy hotfix is 2019-09-18 evening and between 2019-09-20 and 2019-09-22. We kindly ask all users to wait patiently for the pages to load completely. Trying to reload immediately the temporary slow pages do not help with this particular problem at the moment. We apologize for this inconvenience.

  4. monitoring Sep 17, 2019, 07:19 PM UTC

    Fixes for EOL pages and dashboards have been deployed. We keep monitoring the outcome.

  5. monitoring Oct 04, 2019, 01:13 PM UTC

    We have scheduled a maintenance break to resolve the remaining AssetNG Device Register related performance problems on Oct 18 - Oct 20.

  6. monitoring Oct 28, 2019, 07:36 AM UTC

    We keep working on the performance issues with some of our customers. 2019-10-20 update provided help, but there are still some pages behaving with degraded performance.

  7. resolved Nov 15, 2019, 11:00 AM UTC

    The results of 2019-11-14 update look good so far, we keep monitoring the outcome.