Copado incident

Heroku issues in our API

Major Resolved View vendor source →

Copado experienced a major incident on September 19, 2019 affecting CICD, lasting 6h 5m. The incident has been resolved; the full update timeline is below.

Started
Sep 19, 2019, 07:41 AM UTC
Resolved
Sep 19, 2019, 01:47 PM UTC
Duration
6h 5m
Detected by Pingoru
Sep 19, 2019, 07:41 AM UTC

Affected components

CICD

Update timeline

  1. identified Sep 19, 2019, 07:41 AM UTC

    For approximately the past 1 hour, we have noticed an increased error rate in the platform. This is affecting all our api, particularly the ones affected with authentications and org credentials. We are working with Heroku Support to identify and resolve the issue, and will notify any update on this.

  2. identified Sep 19, 2019, 10:48 AM UTC

    We have isolated the incident to intermittent network failures and are working towards minimising the impact on our API

  3. resolved Sep 19, 2019, 01:47 PM UTC

    After our provider corrected the issue, we notice a dramatic decrease in the number of timeout errors. All operations should be back to normal, but we will keep monitoring closely the traffic to prevent another anomaly.