ServiceMax incident

Service Board Service Disruption

Critical Resolved View vendor source →

ServiceMax experienced a critical incident on December 1, 2021 affecting Critical Announcements, lasting 1h 36m. The incident has been resolved; the full update timeline is below.

Started
Dec 01, 2021, 01:45 PM UTC
Resolved
Dec 01, 2021, 03:22 PM UTC
Duration
1h 36m
Detected by Pingoru
Dec 01, 2021, 01:45 PM UTC

Affected components

Critical Announcements

Update timeline

  1. investigating Dec 01, 2021, 01:45 PM UTC

    We are experiencing a Service Board service disruption in production due to the infrastructure service down. Our engineering team is working with the Infrastructure vendor to identify the root cause and resolve the problem. We will provide another update in an hour.

  2. investigating Dec 01, 2021, 02:11 PM UTC

    We are continuing to investigate this issue.

  3. monitoring Dec 01, 2021, 02:19 PM UTC

    The issue has been identified which was caused by the server overloaded on the infrastructure. The infrastructure vendor is working on scaling the consul out of the load-lock. The load goes down and Service Board production is back to function. We will keep monitoring the server status for another hour to ensure the fix is stable.

  4. resolved Dec 01, 2021, 03:22 PM UTC

    Service Board is fully operational now. This incident has been resolved.