Pix4D incident

Delay in processing of projects in Japan cluster

Major Resolved View vendor source →

Pix4D experienced a major incident on July 5, 2021 affecting Processing infrastructure JP, lasting 2h 1m. The incident has been resolved; the full update timeline is below.

Started
Jul 05, 2021, 07:43 AM UTC
Resolved
Jul 05, 2021, 09:45 AM UTC
Duration
2h 1m
Detected by Pingoru
Jul 05, 2021, 07:43 AM UTC

Affected components

Processing infrastructure JP

Update timeline

  1. investigating Jul 05, 2021, 07:43 AM UTC

    Observed increase in the post processing tasks queue in Japan cluster, we are currently investigating the issue.

  2. identified Jul 05, 2021, 07:53 AM UTC

    Processing capacity degraded due to failure of one of the instances. We are currently replacing the failed instance with a healthy one.

  3. monitoring Jul 05, 2021, 09:01 AM UTC

    The new processing instance is provisioned, and pending tasks are being processed.

  4. resolved Jul 05, 2021, 09:45 AM UTC

    All pending tasks have been processed, and queues processing is back to normal processing rate.