software.com incident

Data Processing Delays - Plugins Affected

Major Resolved View vendor source →

software.com experienced a major incident on June 11, 2019 affecting API and Web App, lasting 13h 1m. The incident has been resolved; the full update timeline is below.

Started
Jun 11, 2019, 05:29 PM UTC
Resolved
Jun 12, 2019, 06:30 AM UTC
Duration
13h 1m
Detected by Pingoru
Jun 11, 2019, 05:29 PM UTC

Affected components

APIWeb App

Update timeline

  1. investigating Jun 11, 2019, 05:29 PM UTC

    Our data collection endpoint is experiencing processing delays causing timeouts.

  2. resolved Jun 12, 2019, 07:37 AM UTC

    A problem with our processing queues has been resolved and plugin data updates are back to full capacity.

  3. postmortem Jun 12, 2019, 07:38 AM UTC

    We’ve been working hard to improve our performance when it comes to processing users' data payloads. We know this is super critical to our users, and the value they get from our tools. Performance has proved an ongoing challenge, but a recent switch to a message queue architecture has led to some great improvements in processing capacity. These recent service incidents have been related to this new release as we work out the inevitable bugs that come along with big changes. Onwards and upwards!