Pix4D incident

Elevated Processing Errors

Major Resolved View vendor source →

Pix4D experienced a major incident on June 9, 2022 affecting Processing infrastructure US and Processing infrastructure DE and 1 more component, lasting 6h 32m. The incident has been resolved; the full update timeline is below.

Started
Jun 09, 2022, 06:44 AM UTC
Resolved
Jun 09, 2022, 01:16 PM UTC
Duration
6h 32m
Detected by Pingoru
Jun 09, 2022, 06:44 AM UTC

Affected components

Processing infrastructure USProcessing infrastructure DEProcessing infrastructure JPProcessing infrastructure KR

Update timeline

  1. investigating Jun 09, 2022, 06:44 AM UTC

    We're experiencing an elevated level of processing errors and are currently investigating the issue.

  2. investigating Jun 09, 2022, 07:58 AM UTC

    Still investigating the issue, we will post any update later.

  3. investigating Jun 09, 2022, 08:30 AM UTC

    We will reschedule failed projects due to the incident for all customers, no need to reschedule them on your side. We understand the failure but we are still investigating to understand the root cause.

  4. identified Jun 09, 2022, 09:28 AM UTC

    The issue has been identified and a corresponding patch has been deployed.

  5. monitoring Jun 09, 2022, 09:58 AM UTC

    We are monitoring the situation. The patch has been rolled out at 09:15 UTC.

  6. monitoring Jun 09, 2022, 12:01 PM UTC

    The situation looks back to normal from our monitoring, we have started re-processing the failed projects by batches. We keep monitoring the situation.

  7. resolved Jun 09, 2022, 01:16 PM UTC

    The incident is closed, all projects are processing again in all regions successfully.