Flxpoint incident

Known Issue with File Uploads

Major Resolved View vendor source →

Flxpoint experienced a major incident on June 1, 2023 affecting App, lasting 26m. The incident has been resolved; the full update timeline is below.

Started
Jun 01, 2023, 04:01 PM UTC
Resolved
Jun 01, 2023, 04:27 PM UTC
Duration
26m
Detected by Pingoru
Jun 01, 2023, 04:01 PM UTC

Affected components

App

Update timeline

  1. investigating Jun 01, 2023, 04:01 PM UTC

    We are currently investigating an issue that occurs while uploading files.

  2. resolved Jun 01, 2023, 04:27 PM UTC

    The issue is now resolved. The root cause stemmed from our infrastructure monitoring solution; DataDog. DataDog released a new monitoring agent today that unfortunately broke File Uploads for many of their customers. More information about this can be found here : https://github.com/DataDog/dd-trace-java/issues/5298 After identifying the issue, we've temporarily downgraded the version of the agent we are using and have confirmed uploads are now functioning as intended again. We will conduct an analysis internally to see how we can prevent these 3rd Party issues from impacting our production workloads in the future.