BenchPrep incident

Degraded Performance

Critical Resolved View vendor source →

BenchPrep experienced a critical incident on September 7, 2021 affecting API and Learning Application, lasting 3h 23m. The incident has been resolved; the full update timeline is below.

Started
Sep 07, 2021, 03:47 PM UTC
Resolved
Sep 07, 2021, 07:10 PM UTC
Duration
3h 23m
Detected by Pingoru
Sep 07, 2021, 03:47 PM UTC

Affected components

APILearning Application

Update timeline

  1. investigating Sep 07, 2021, 03:47 PM UTC

    We are investigating degraded performance reported by a number of our applications pods

  2. investigating Sep 07, 2021, 03:52 PM UTC

    Updating to outage. Teams are looking into the issue

  3. identified Sep 07, 2021, 04:24 PM UTC

    We are seeing network issues that we are actively working with the Cloud Provider on, in the meantime one datacenter is back, routed traffic to it and switch back to degraded performance

  4. monitoring Sep 07, 2021, 04:31 PM UTC

    Confirmed packet loss & networking issues with the cloud provider, services are back, but we will keep the incident open until we hear official confirmation that it is resolved.

  5. monitoring Sep 07, 2021, 04:34 PM UTC

    We are continuing to monitor for any further issues.

  6. resolved Sep 07, 2021, 07:10 PM UTC

    Attaching IBM incident https://cloud.ibm.com/status?item=INC4252245